-- Logs begin at Fri 2022-08-19 13:57:14 UTC, end at Fri 2022-08-19 15:04:59 UTC. -- Aug 19 14:37:28.271024 dv-osbrick-849840-6-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 14:37:28.280258 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 14:37:28 2022] *** Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: nodename: dv-osbrick-849840-6-ceph Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: machine: x86_64 Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: clock source: unix Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: pcre jit disabled Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: detected number of CPU cores: 4 Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: current working directory: / Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: detected binary path: /usr/bin/uwsgi-core Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: your processes number limit is 47680 Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: your memory page size is 4096 bytes Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: detected max file descriptor number: 2048 Aug 19 14:37:28.283946 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: lock engine: pthread robust mutexes Aug 19 14:37:28.285889 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: thunder lock: enabled Aug 19 14:37:28.285889 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 14:37:28.285889 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 14:37:28.331254 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: Python main interpreter initialized at 0x564984abe9c0 Aug 19 14:37:28.331254 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: python threads support enabled Aug 19 14:37:28.331254 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: your server socket listen backlog is limited to 100 connections Aug 19 14:37:28.331254 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: your mercy for graceful operations on workers is 90 seconds Aug 19 14:37:28.331651 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 14:37:28.331651 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: *** Operational MODE: preforking *** Aug 19 14:37:28.331966 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: *** uWSGI is running in multiple interpreter mode *** Aug 19 14:37:28.331966 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: spawned uWSGI master process (pid: 99819) Aug 19 14:37:28.332160 dv-osbrick-849840-6-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 19 14:37:28.334947 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: spawned uWSGI worker 1 (pid: 99833, cores: 1) Aug 19 14:37:28.334947 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: spawned uWSGI worker 2 (pid: 99834, cores: 1) Aug 19 14:37:28.334947 dv-osbrick-849840-6-ceph devstack@keystone.service[99819]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 14:37:32.980349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 14:37:32.980349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: from cryptography.utils import int_from_bytes Aug 19 14:37:32.981195 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 14:37:32.981195 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: from cryptography.utils import int_from_bytes Aug 19 14:37:32.992430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 14:37:32.992430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: from cryptography.utils import int_from_bytes Aug 19 14:37:32.992991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 14:37:32.992991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: from cryptography.utils import int_from_bytes Aug 19 14:37:33.032788 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 14:37:33.033033 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 14:37:33.033154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] command line args: [] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 14:37:33.033380 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 14:37:33.033572 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ================================================================================ {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 14:37:33.033847 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] admin_token = **** {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.034095 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] config_dir = [] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.034286 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.034502 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] config_source = [] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.034678 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] debug = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.034859 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.035270 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.035469 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] insecure_debug = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.035724 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.035973 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.036212 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] list_limit = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.036372 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] log_config_append = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.036567 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.036698 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] log_dir = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.036883 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] log_file = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.037121 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.037400 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.037663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.037945 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.038164 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.038337 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.038610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.038856 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.039094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.039328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.039559 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.039793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.040042 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.040267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] notification_format = cadf {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.040639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.041225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.041347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] publish_errors = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.041581 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.041813 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.042056 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.042289 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.042526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.042770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] standard_threads = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.043003 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] strict_password_check = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.043249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.043427 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] use_eventlog = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.043608 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] use_journal = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.043803 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] use_json = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.043943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] use_stderr = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.044119 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] use_syslog = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.044351 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] watch_log_file = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.044617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.044863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.045127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.045369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.045619 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.045860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.046137 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.046374 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.046623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.046778 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 14:37:33.046962 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.047059 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 14:37:33.047184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] command line args: [] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 14:37:33.047265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.047416 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.047510 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 14:37:33.047648 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ================================================================================ {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 14:37:33.047739 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.047929 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.048158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.048412 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.048664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.048956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.049278 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.049481 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.049724 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.050017 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.050203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] admin_token = **** {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.050309 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.050479 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] config_dir = [] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.050635 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.050720 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.050792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.050862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] config_source = [] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.050980 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.051064 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] debug = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.051189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.051290 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.051425 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.051559 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.051634 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] insecure_debug = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.051704 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.051848 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.051926 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.052095 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.052184 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.052365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.052446 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] list_limit = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.052567 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] log_config_append = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.052642 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.052780 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.052884 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.052957 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] log_dir = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.053103 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.053214 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] log_file = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.053334 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.053435 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.053581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.053692 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.053829 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.053967 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.054093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.054234 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.054349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.054433 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.054506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.054654 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.054735 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.054896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.054977 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.055125 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.055211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.055352 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.055431 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.055579 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.055663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.055809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.055886 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.056108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.056187 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.056351 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.056575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] notification_format = cadf {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.056658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.056830 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.057065 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.057146 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.057337 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.057530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.057609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.057759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] publish_errors = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.057886 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.058019 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.058148 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.058251 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.058369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.058450 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.058532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.058660 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.058783 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.058890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.059017 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.059122 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] standard_threads = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.059289 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.059368 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] strict_password_check = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.059529 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.059621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.059769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.060002 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.060264 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.060503 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.060738 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.060978 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.061216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.061492 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.061733 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.062009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.062261 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.062505 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.062744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.062982 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.063232 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.enabled = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.063471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.063619 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] use_eventlog = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.063698 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.063810 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] use_journal = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.064250 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.064408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] use_json = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.064483 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] use_stderr = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.064552 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.064621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] use_syslog = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.064768 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.064854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] watch_log_file = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 14:37:33.064999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.065084 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.065323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.065398 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.065587 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.065665 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.065835 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.066002 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.066158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.066239 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.066436 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.066551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.066693 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.066797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.066932 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.067021 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.067181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.067330 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.067418 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.067491 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.067666 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.067744 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.067899 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.068007 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.068130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.068219 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.068366 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.068551 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.068636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.068748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.068834 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.068907 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.069156 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.069249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.069323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.069418 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.069594 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.069674 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.069780 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.069873 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.070037 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.070123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.070291 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.070385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.070550 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.070637 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.070792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] auth.external = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.070877 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.071026 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] auth.mapped = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.071113 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.071250 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.071326 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.071544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.072043 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] auth.password = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.073428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] auth.token = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.073428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.073428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] catalog.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.073428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.073428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.073881 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.074027 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.074027 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.074178 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.075586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] credential.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.075668 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.075908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.076169 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.076426 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.076662 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.076835 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] credential.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.076925 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.077135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.077385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.077622 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.077728 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.077871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.078050 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.078135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.078314 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.078387 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.078571 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.078801 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.079028 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.079287 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.079516 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.079717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.079841 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.079956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.080044 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.080204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.080344 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.080427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.080508 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.080661 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.080785 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.080875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.081040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.081164 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.081340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.081474 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.081555 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.081626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.081780 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.081856 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.082002 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.082090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.082247 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.082372 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.082451 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.082613 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] federation.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.082738 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.082817 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.082889 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.083096 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] federation.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.083350 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.083573 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.083875 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.084107 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.084368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.084649 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.084910 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.085188 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.085442 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.085704 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.086008 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.086286 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.086570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.086815 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.087007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.087090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.087308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.087385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.087556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.087647 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.087796 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.087881 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.088055 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.088137 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.088291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.088369 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.088525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.088602 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.088758 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.088838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.088994 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.089071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.089243 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.089329 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.089496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.089776 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.089854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.090052 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.090134 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.090331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.090419 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.090573 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.090660 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.090813 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.090924 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.091043 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.091122 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.091283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.091361 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.enabled = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.091517 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.091594 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.091753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.091832 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.091996 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.092081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.092235 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.092318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.092471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.092551 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.092706 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.092785 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.092941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.093021 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.093178 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.093257 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.093435 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.093512 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.093672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.093749 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.093938 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.094022 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.094174 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.094311 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.094401 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.094563 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.094650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.password = **** {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.094800 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.094880 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.095038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.095118 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.095273 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.095360 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.095504 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.095583 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.095759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.095851 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.096033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.096145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.096300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.096389 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.096514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.096591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.096759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.096851 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.096998 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.097078 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.097248 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.097328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.097814 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098021 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098102 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098176 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098249 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098394 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098474 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098549 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] auth.external = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098621 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098693 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] auth.mapped = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098875 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.098957 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.099109 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.099198 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.099376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] auth.password = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.099454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.099604 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] auth.token = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.099683 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.099840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.099920 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.100073 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] catalog.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.100161 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.100302 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.100381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.100531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.100610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.100776 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.100856 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.101017 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.101152 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.101236 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.101309 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.101457 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] credential.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.101536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.101698 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] credential.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.101791 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.101964 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.102047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.102214 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.102300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.102445 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.102533 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.102672 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.102750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.103253 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.103348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.103423 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.103505 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.103578 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.103651 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.103722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.103815 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.103888 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.103968 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.104142 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.104336 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.104414 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.104597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.104675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.104862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.104942 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] policy.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.105096 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.105172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.105347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.105437 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.105579 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] federation.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.105664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.105808 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.105888 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] receipt.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.106079 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] federation.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.106165 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.106327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.106422 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.106557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.106660 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.106788 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.106869 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.107022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.107102 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.107261 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] resource.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.107340 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.107491 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.107570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.107742 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.107822 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] resource.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.107974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.108053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.108217 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.108308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.108448 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.108529 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.108693 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] revoke.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.108771 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.108933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.109011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.109167 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.109246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.109395 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.109474 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] role.cache_time = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.109631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] role.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.109747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.109846 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.110097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.110253 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] role.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.110378 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.110506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] role.list_limit = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.110631 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.110771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.110897 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.111022 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.111144 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.111268 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.111390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.111536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.111659 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.111782 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.111906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.112030 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.112160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.112291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.112423 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.112548 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.112668 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.112794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.112926 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.113050 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.113183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.113306 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.113429 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.113553 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.113685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.113808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.113953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.113953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.114186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.114309 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.114444 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.114568 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.114692 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.114825 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.114949 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.115074 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.115204 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.115327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.115449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.115572 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.115693 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.115818 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.115818 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.116061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.116184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.116308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.116430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.116562 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.116693 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.116816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.116938 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.117060 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.117184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.password = **** {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.117305 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.117441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.117564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.117692 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.117816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.117953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.118074 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.118220 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.118344 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.118468 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.118653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.118776 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.118904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] token.cache_time = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.119040 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.119171 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] token.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.119296 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.119419 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.119549 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.119673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] token.provider = fernet {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.119673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.119918 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.120058 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.120183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.120183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.120418 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.120549 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.120672 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.120796 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.120920 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.121043 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.121161 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.121361 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.121496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] trust.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.121620 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.121743 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.121877 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.122017 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.122153 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.122277 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.122401 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.122524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.122647 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.122771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.122902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.123025 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.123149 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.123272 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.123396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.123541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.123665 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.123665 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.123899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.connection = **** {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.124030 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.124162 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.124285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.124408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.124543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.124666 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.124790 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.124919 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.125042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.125164 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.125305 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.125428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.125553 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.125675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.125800 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.126003 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.126136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.126262 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.126386 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.126510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.126637 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.126760 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.126893 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.127019 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.127149 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.127232 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.127371 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.127449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.127520 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.127692 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.127812 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] policy.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.127960 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128082 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128203 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128334 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128455 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128455 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 14:37:33.128694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] receipt.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.128694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.129502 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] resource.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.129502 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.129502 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] resource.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.129844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.129844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.130128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.130363 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] revoke.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.130606 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.130838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.131074 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] role.cache_time = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.131305 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] role.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.131548 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] role.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.131776 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] role.list_limit = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.132022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.132265 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.132509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.132750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.132990 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.133232 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.133472 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.133713 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.133959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.134341 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.134589 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.134933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.135185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.135611 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.135843 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.136089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.136335 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.136582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.136828 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.137061 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.137312 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.137561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.137796 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.138048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.138278 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.138505 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.138750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.139001 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.139244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.139475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.139706 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.139930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] token.cache_time = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.140161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] token.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.140393 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.140636 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] token.provider = fernet {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.140868 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.141118 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.141360 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.141595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.141834 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.142104 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.142350 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] trust.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.142580 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.142812 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.143040 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.143280 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.143525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.143748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.143988 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.144284 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.144542 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.connection = **** {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.144783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.145026 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.145258 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.145494 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.145725 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.145984 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.146218 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.146451 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.146692 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.146922 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.147164 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.147394 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.147635 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.147867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.148106 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.148331 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.148567 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.148799 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 14:37:33.148966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 14:37:33.158446 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.158689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.158888 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.168369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.174393 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.174616 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.174838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.183872 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.197411 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.197624 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.202798 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.203010 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.252906 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.253153 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.302361 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.302580 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.303732 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.303968 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.371862 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.372084 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.372293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.372515 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.372731 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.372945 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.374081 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.374342 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.374565 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.374783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.375046 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.375201 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.397658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.397864 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.397983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.398087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.398166 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.398229 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.398348 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.398433 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.398599 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.398750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.398830 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.398895 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.398956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.399016 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.410788 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.412183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.424018 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.424229 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.424458 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.424715 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.424936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.425151 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.425351 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99833) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.432495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.432723 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.432904 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.433112 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.433337 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.433546 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.433751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99834) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 14:37:33.443088 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.443299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 14:37:33.443642 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.443849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 14:37:33.443983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.444086 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.444183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 14:37:33.444383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.444509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.444667 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.444791 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 14:37:33.444884 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.444962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.445185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.445442 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.445673 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.454861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.455146 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.455414 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.455536 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.455664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.455748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.456017 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.456295 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.462904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.463802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.466160 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.466453 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.466697 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.466831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.466978 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.467102 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.467251 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.467344 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.467533 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.467658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.467816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.467946 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.468048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.468116 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.468310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.468404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.468580 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.468682 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.468850 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.468941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.469120 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.469383 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.492127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.492348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.493806 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.494139 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.494340 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.494615 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.499034 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.499345 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.499647 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.499763 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.499953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.501956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.508007 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.508235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.508360 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.508644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.512355 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.512655 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.512839 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.512942 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.513128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.513222 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.513411 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.513612 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.513834 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.513995 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.514103 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.514211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.514418 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.514542 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.514660 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.514967 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.530550 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.530831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.530953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.531091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.534777 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.535086 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.537869 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.538190 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.538317 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.538594 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.542581 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.543016 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.545750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.546127 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.548848 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.549151 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.549295 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.549433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.549517 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.549756 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.549880 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.550152 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.550330 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.550421 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.550536 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.550684 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.566766 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.567058 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.567181 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.567363 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.567452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.567572 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.567732 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.567997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.574538 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.574861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.576205 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.576465 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.576563 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.576795 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.579293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.579421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.579630 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.579776 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.579960 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.580080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.580163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.580227 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.580465 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.580592 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.591822 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.592091 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.592225 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.592325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.592409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.592625 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.592755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.592953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.593082 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.593221 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.593301 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.593456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.593595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.593828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.608815 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.609322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.611833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.612224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.614843 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.615269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.616280 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.616711 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.617737 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.618060 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.618184 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.618321 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.618441 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.618823 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.624804 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.625305 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.626287 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.626826 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.629251 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.629547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.629861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.630014 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.630150 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.630249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.630456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.630702 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.638140 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.638428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.638704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.638828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.639022 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.639325 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.645466 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=99834) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.646104 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=99833) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 14:37:33.646776 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.647059 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.647345 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.647469 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.647632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.647744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.647891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.648011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.648211 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.648336 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.648471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.648553 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.648701 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.648841 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.648978 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.649060 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.649215 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.649322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.649450 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.649596 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.649723 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.649950 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.650240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.650333 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=99834) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.650527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.650792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=99833) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 14:37:33.684696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564984abe9c0 pid: 99833 (default app) Aug 19 14:37:33.685974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564984abe9c0 pid: 99834 (default app) Aug 19 14:37:33.688372 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0102-6c08-434b-9d99-eb4f301d97aa None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:33.688659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0102-6c08-434b-9d99-eb4f301d97aa None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:33.689213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0102-6c08-434b-9d99-eb4f301d97aa None None] PATH_INFO: `/v3` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:33.693726 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Fri Aug 19 14:37:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:37:40.956704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9ab97-b811-4da7-931f-79a60f3ca163 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:40.957314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9ab97-b811-4da7-931f-79a60f3ca163 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:40.957314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9ab97-b811-4da7-931f-79a60f3ca163 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:40.961732 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:37:40.968183 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:40.968905 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:40.969058 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:41.056141 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: INFO dbcounter [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] Registered counter for database keystone Aug 19 14:37:41.078649 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG oslo_db.sqlalchemy.engines [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 14:37:41.090088 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writer thread running {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 14:37:41.304250 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG passlib.handlers.bcrypt [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=99833) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 14:37:41.304676 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG passlib.handlers.bcrypt [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=99833) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 14:37:41.366540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:41.369307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:41.518997 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 553 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 14:37:42.068987 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9ab97-b811-4da7-931f-79a60f3ca163 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:42.146526 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: INFO dbcounter [None req-efe9ab97-b811-4da7-931f-79a60f3ca163 None None] Registered counter for database keystone Aug 19 14:37:42.171949 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG oslo_db.sqlalchemy.engines [None req-efe9ab97-b811-4da7-931f-79a60f3ca163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 14:37:42.181501 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writer thread running {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 14:37:42.308209 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9ab97-b811-4da7-931f-79a60f3ca163 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:42.313714 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d6ea8-3a59-401a-b076-0c2c63cf4099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:42.314689 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d6ea8-3a59-401a-b076-0c2c63cf4099 admin admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:42.314942 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d6ea8-3a59-401a-b076-0c2c63cf4099 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:42.315234 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d6ea8-3a59-401a-b076-0c2c63cf4099 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:42.325029 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d6ea8-3a59-401a-b076-0c2c63cf4099 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:42.375989 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f89d6ea8-3a59-401a-b076-0c2c63cf4099 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 14:37:42.376321 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d6ea8-3a59-401a-b076-0c2c63cf4099 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:42.387920 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Fri Aug 19 14:37:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 14:37:42.397538 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:42.415164 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53f961-34fb-41c1-81ea-15427867db8f None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:42.421083 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354027e-ded5-4340-92f1-c244b0b02fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:42.422311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354027e-ded5-4340-92f1-c244b0b02fdf admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:42.422594 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354027e-ded5-4340-92f1-c244b0b02fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:42.422859 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354027e-ded5-4340-92f1-c244b0b02fdf admin admin] PATH_INFO: `/v3/projects/c5667f138f3a41d2b41486682bb7771c` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:42.426996 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354027e-ded5-4340-92f1-c244b0b02fdf admin admin] RBAC: Authorizing `identity:get_project(project_id=c5667f138f3a41d2b41486682bb7771c)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:42.478526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0354027e-ded5-4340-92f1-c244b0b02fdf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 14:37:42.478854 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354027e-ded5-4340-92f1-c244b0b02fdf admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:42.483802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Fri Aug 19 14:37:42 2022] GET /identity/v3/projects/c5667f138f3a41d2b41486682bb7771c => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:37:44.652977 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d60eec-66f4-4040-964c-00ce8eef7777 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:44.653510 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d60eec-66f4-4040-964c-00ce8eef7777 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:44.653510 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d60eec-66f4-4040-964c-00ce8eef7777 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:44.657836 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:37:44.663998 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542f2c1-64b8-4149-8b5a-97bf6e5930e0 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:44.664609 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542f2c1-64b8-4149-8b5a-97bf6e5930e0 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:44.664832 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542f2c1-64b8-4149-8b5a-97bf6e5930e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:44.687405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-1542f2c1-64b8-4149-8b5a-97bf6e5930e0 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:44.689294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-1542f2c1-64b8-4149-8b5a-97bf6e5930e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:44.699277 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 19 14:37:45.019398 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d60eec-66f4-4040-964c-00ce8eef7777 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:45.037425 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d60eec-66f4-4040-964c-00ce8eef7777 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:45.043868 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213d01b-4442-4f5e-b177-5804973264d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:45.044518 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d01b-4442-4f5e-b177-5804973264d5 admin admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:45.044798 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d01b-4442-4f5e-b177-5804973264d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:45.045091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d01b-4442-4f5e-b177-5804973264d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:45.054875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213d01b-4442-4f5e-b177-5804973264d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:45.056960 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213d01b-4442-4f5e-b177-5804973264d5 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:45.067774 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Fri Aug 19 14:37:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 14:37:45.075149 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542f2c1-64b8-4149-8b5a-97bf6e5930e0 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:45.086612 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542f2c1-64b8-4149-8b5a-97bf6e5930e0 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:45.093486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5031b8-c262-4ec7-be5b-58350398f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:45.094175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5031b8-c262-4ec7-be5b-58350398f6cf admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:45.094449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5031b8-c262-4ec7-be5b-58350398f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:45.094721 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5031b8-c262-4ec7-be5b-58350398f6cf admin admin] PATH_INFO: `/v3/users/27969228664649ed9665cfa9861d3064` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:45.096141 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5031b8-c262-4ec7-be5b-58350398f6cf admin admin] RBAC: Authorizing `identity:get_user(user_id=27969228664649ed9665cfa9861d3064)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:45.098239 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5031b8-c262-4ec7-be5b-58350398f6cf admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:45.100234 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Fri Aug 19 14:37:45 2022] GET /identity/v3/users/27969228664649ed9665cfa9861d3064 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:37:47.487615 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88f6c1-ddc4-45de-af47-225af20fac99 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:47.488204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88f6c1-ddc4-45de-af47-225af20fac99 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:47.488316 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88f6c1-ddc4-45de-af47-225af20fac99 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:47.490692 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:37:47.496686 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a916f-35e3-4c91-ad0b-1285aa28b218 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:47.497306 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a916f-35e3-4c91-ad0b-1285aa28b218 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:47.497306 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a916f-35e3-4c91-ad0b-1285aa28b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:47.517218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-f22a916f-35e3-4c91-ad0b-1285aa28b218 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:47.518472 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-f22a916f-35e3-4c91-ad0b-1285aa28b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:47.621314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df3fe2-5fed-49c4-bdc5-63d3ba5b7ae1 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:47.621765 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df3fe2-5fed-49c4-bdc5-63d3ba5b7ae1 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:47.622100 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df3fe2-5fed-49c4-bdc5-63d3ba5b7ae1 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:47.623445 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:37:47.625900 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:37:47.629990 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d48f-7b29-4817-a7ae-90e5e56d214a None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:47.630527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d48f-7b29-4817-a7ae-90e5e56d214a None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:47.630907 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d48f-7b29-4817-a7ae-90e5e56d214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:47.676121 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG passlib.handlers.bcrypt [None req-fef0d48f-7b29-4817-a7ae-90e5e56d214a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=99834) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 14:37:47.676373 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG passlib.handlers.bcrypt [None req-fef0d48f-7b29-4817-a7ae-90e5e56d214a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=99834) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 14:37:47.722183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-fef0d48f-7b29-4817-a7ae-90e5e56d214a None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:47.723823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-fef0d48f-7b29-4817-a7ae-90e5e56d214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:47.831991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:37:47.973002 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a916f-35e3-4c91-ad0b-1285aa28b218 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:48.004946 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:48.166271 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d48f-7b29-4817-a7ae-90e5e56d214a None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:48.204361 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a916f-35e3-4c91-ad0b-1285aa28b218 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:48.241158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78fbe0-e014-41d3-a569-31d4da53bc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:48.241717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78fbe0-e014-41d3-a569-31d4da53bc44 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:48.242022 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78fbe0-e014-41d3-a569-31d4da53bc44 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:48.242292 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78fbe0-e014-41d3-a569-31d4da53bc44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:48.254006 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78fbe0-e014-41d3-a569-31d4da53bc44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-8a78fbe0-e014-41d3-a569-31d4da53bc44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:37:48.263071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:37:48.265235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:37:48.267407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:37:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:37:48.271690 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d48f-7b29-4817-a7ae-90e5e56d214a None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:48.272838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78fbe0-e014-41d3-a569-31d4da53bc44 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:48.274130 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:48.313130 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed28df-6d53-40f3-b0bb-aceac2f889ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:48.314346 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed28df-6d53-40f3-b0bb-aceac2f889ef None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:48.314630 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed28df-6d53-40f3-b0bb-aceac2f889ef None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:48.314903 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed28df-6d53-40f3-b0bb-aceac2f889ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:48.363346 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:48.383919 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78fbe0-e014-41d3-a569-31d4da53bc44 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:48.397009 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed28df-6d53-40f3-b0bb-aceac2f889ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:48.398616 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed28df-6d53-40f3-b0bb-aceac2f889ef None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:48.419885 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7fbb2-3d35-4856-b333-d3a943f13dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:48.420496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7fbb2-3d35-4856-b333-d3a943f13dc2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:48.420769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7fbb2-3d35-4856-b333-d3a943f13dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:48.421037 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7fbb2-3d35-4856-b333-d3a943f13dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:48.421705 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7fbb2-3d35-4856-b333-d3a943f13dc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:37:48.422037 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7fbb2-3d35-4856-b333-d3a943f13dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:48.423458 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7fbb2-3d35-4856-b333-d3a943f13dc2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:48.437896 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:37:48.443993 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7fbb2-3d35-4856-b333-d3a943f13dc2 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:48.506176 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:37:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 14:37:48.512516 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed28df-6d53-40f3-b0bb-aceac2f889ef None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:48.515525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:48.553050 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7fbb2-3d35-4856-b333-d3a943f13dc2 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:48.590860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496785d-662f-4b90-b0fe-b99b66aac4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:48.591506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496785d-662f-4b90-b0fe-b99b66aac4d6 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:48.591785 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496785d-662f-4b90-b0fe-b99b66aac4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:48.592058 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496785d-662f-4b90-b0fe-b99b66aac4d6 None admin] PATH_INFO: `/v3/users/27969228664649ed9665cfa9861d3064` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:48.593241 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496785d-662f-4b90-b0fe-b99b66aac4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=27969228664649ed9665cfa9861d3064)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:48.594758 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496785d-662f-4b90-b0fe-b99b66aac4d6 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:48.596391 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:37:48 2022] GET /identity/v3/users/27969228664649ed9665cfa9861d3064 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:37:48.603479 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496785d-662f-4b90-b0fe-b99b66aac4d6 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:48.619200 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:48.627344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed28df-6d53-40f3-b0bb-aceac2f889ef None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:48.669674 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0e518-dc83-43ec-8131-4ad28efec3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:48.670591 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0e518-dc83-43ec-8131-4ad28efec3fd None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:48.670868 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0e518-dc83-43ec-8131-4ad28efec3fd None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:48.671131 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0e518-dc83-43ec-8131-4ad28efec3fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:48.691643 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0e518-dc83-43ec-8131-4ad28efec3fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:48.693131 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0e518-dc83-43ec-8131-4ad28efec3fd None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-e3b0e518-dc83-43ec-8131-4ad28efec3fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:37:48.713827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:37:48.715453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:37:48.717000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:37:48.717000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:37:48.717000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:37:48.717000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:37:48.719652 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496785d-662f-4b90-b0fe-b99b66aac4d6 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:48.722428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0e518-dc83-43ec-8131-4ad28efec3fd None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:48.759254 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb988ab2-afb4-41e3-a3e7-0efb3dc5b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:48.759810 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb988ab2-afb4-41e3-a3e7-0efb3dc5b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:48.760080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb988ab2-afb4-41e3-a3e7-0efb3dc5b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:48.760352 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb988ab2-afb4-41e3-a3e7-0efb3dc5b4c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:48.761706 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb988ab2-afb4-41e3-a3e7-0efb3dc5b4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:48.763219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb988ab2-afb4-41e3-a3e7-0efb3dc5b4c9 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:48.764843 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:37:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:37:48.770649 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb988ab2-afb4-41e3-a3e7-0efb3dc5b4c9 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:48.788152 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:48.872775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:48.894609 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb988ab2-afb4-41e3-a3e7-0efb3dc5b4c9 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:48.932433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1711fa-a4d7-4836-92c8-630320567ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:48.933062 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1711fa-a4d7-4836-92c8-630320567ff5 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:48.933386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1711fa-a4d7-4836-92c8-630320567ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:48.933660 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1711fa-a4d7-4836-92c8-630320567ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:48.934416 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1711fa-a4d7-4836-92c8-630320567ff5 None admin] RBAC: Adding query filter params (role.id=d444334199c640a7af820f46e283d49d, scope.domain.id=default, user.id=27969228664649ed9665cfa9861d3064) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:37:48.934740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1711fa-a4d7-4836-92c8-630320567ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:48.936185 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1711fa-a4d7-4836-92c8-630320567ff5 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:48.944445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1322 bytes} [Fri Aug 19 14:37:48 2022] GET /identity/v3/role_assignments?user.id=27969228664649ed9665cfa9861d3064&scope.domain.id=default&role.id=d444334199c640a7af820f46e283d49d => generated 233 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:37:48.948912 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0e518-dc83-43ec-8131-4ad28efec3fd None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:48.990689 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ca725-6fed-46ff-a513-50297a0ca994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:48.991320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ca725-6fed-46ff-a513-50297a0ca994 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:48.991594 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ca725-6fed-46ff-a513-50297a0ca994 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:48.991868 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ca725-6fed-46ff-a513-50297a0ca994 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:48.992523 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ca725-6fed-46ff-a513-50297a0ca994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:37:48.992820 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ca725-6fed-46ff-a513-50297a0ca994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:48.994268 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ca725-6fed-46ff-a513-50297a0ca994 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:49.017572 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:37:51.577559 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91444d-b599-4bb7-88b8-cb50e13ec17b None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:51.578595 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91444d-b599-4bb7-88b8-cb50e13ec17b None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:51.579071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91444d-b599-4bb7-88b8-cb50e13ec17b None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:51.580631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:37:51.587845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693e15-f2f6-4e6d-8d8c-8d6e09689ee0 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:51.588391 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693e15-f2f6-4e6d-8d8c-8d6e09689ee0 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:51.588795 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693e15-f2f6-4e6d-8d8c-8d6e09689ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:51.619587 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-95693e15-f2f6-4e6d-8d8c-8d6e09689ee0 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:51.621567 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-95693e15-f2f6-4e6d-8d8c-8d6e09689ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:51.723922 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:37:51.873378 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d228-3875-44d1-9269-102afafbce8d None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:51.874063 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d228-3875-44d1-9269-102afafbce8d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:51.874523 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d228-3875-44d1-9269-102afafbce8d None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:51.876341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:37:51.882330 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc5529-c78c-4f54-bb63-667bbb8addcc None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:51.882900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc5529-c78c-4f54-bb63-667bbb8addcc None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:51.883359 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc5529-c78c-4f54-bb63-667bbb8addcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:51.907126 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-5cfc5529-c78c-4f54-bb63-667bbb8addcc None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:51.908751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-5cfc5529-c78c-4f54-bb63-667bbb8addcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:51.976524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:52.010063 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 12/25] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:37:52.068930 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7506-b741-40d3-9493-0d0e986a0deb None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:52.069552 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7506-b741-40d3-9493-0d0e986a0deb None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:52.070031 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7506-b741-40d3-9493-0d0e986a0deb None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:52.071883 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 14/26] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:37:52.078018 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a124144-b7e3-4648-998c-84e170f3c10e None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:52.078593 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a124144-b7e3-4648-998c-84e170f3c10e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:52.079083 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a124144-b7e3-4648-998c-84e170f3c10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:52.105784 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-9a124144-b7e3-4648-998c-84e170f3c10e None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:52.107439 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-9a124144-b7e3-4648-998c-84e170f3c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:52.217044 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 13/27] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:37:52.309072 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f7506-b741-40d3-9493-0d0e986a0deb None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:52.458379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b81ced-6163-42e3-a64e-565ce5aa7a94 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:52.458707 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b81ced-6163-42e3-a64e-565ce5aa7a94 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:52.458918 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b81ced-6163-42e3-a64e-565ce5aa7a94 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:52.460376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 14/28] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:37:52.460732 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f7506-b741-40d3-9493-0d0e986a0deb None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:52.477553 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c766-33e4-421d-9e96-b5d9f7e9b84f None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:52.477977 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c766-33e4-421d-9e96-b5d9f7e9b84f None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:52.478383 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c766-33e4-421d-9e96-b5d9f7e9b84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:52.531947 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-ee82c766-33e4-421d-9e96-b5d9f7e9b84f None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:52.533162 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-ee82c766-33e4-421d-9e96-b5d9f7e9b84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:52.568890 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c1d0-ae8c-48c7-9ef2-5db17f5614f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:52.569460 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c1d0-ae8c-48c7-9ef2-5db17f5614f0 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:52.569731 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c1d0-ae8c-48c7-9ef2-5db17f5614f0 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:52.570026 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c1d0-ae8c-48c7-9ef2-5db17f5614f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:52.595728 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679c1d0-ae8c-48c7-9ef2-5db17f5614f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-5679c1d0-ae8c-48c7-9ef2-5db17f5614f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:37:52.601213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:37:52.602108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:37:52.602864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:37:52.607679 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 15/29] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:37:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:37:52.611424 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c1d0-ae8c-48c7-9ef2-5db17f5614f0 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:52.624863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:52.708586 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 15/30] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:37:52.737423 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82c766-33e4-421d-9e96-b5d9f7e9b84f None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:52.806325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:52.828414 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c1d0-ae8c-48c7-9ef2-5db17f5614f0 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:52.876737 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e018e-f5e8-42c0-b741-ceff90b02f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:52.877373 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e018e-f5e8-42c0-b741-ceff90b02f8a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:52.877645 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e018e-f5e8-42c0-b741-ceff90b02f8a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:52.877930 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e018e-f5e8-42c0-b741-ceff90b02f8a None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:52.878607 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e018e-f5e8-42c0-b741-ceff90b02f8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:37:52.878900 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e018e-f5e8-42c0-b741-ceff90b02f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:52.880303 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e018e-f5e8-42c0-b741-ceff90b02f8a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:52.903943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 16/31] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:37:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:37:52.913859 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e018e-f5e8-42c0-b741-ceff90b02f8a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:52.942571 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82c766-33e4-421d-9e96-b5d9f7e9b84f None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:53.015660 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53216451-d814-48a2-a8df-15c7a7b0e498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:53.016686 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53216451-d814-48a2-a8df-15c7a7b0e498 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.017168 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53216451-d814-48a2-a8df-15c7a7b0e498 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.017617 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53216451-d814-48a2-a8df-15c7a7b0e498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.037055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53216451-d814-48a2-a8df-15c7a7b0e498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:53.038594 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53216451-d814-48a2-a8df-15c7a7b0e498 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:53.040032 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-53216451-d814-48a2-a8df-15c7a7b0e498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:37:53.075543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:37:53.076482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:37:53.077275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:37:53.077275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:37:53.077275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:37:53.081870 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 16/32] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:37:53.083854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53216451-d814-48a2-a8df-15c7a7b0e498 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:53.144074 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e018e-f5e8-42c0-b741-ceff90b02f8a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:53.202722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:53.220691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53216451-d814-48a2-a8df-15c7a7b0e498 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:53.264380 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af275ab-253a-47de-8a47-74c32ce9ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:53.265046 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af275ab-253a-47de-8a47-74c32ce9ca8b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.265349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af275ab-253a-47de-8a47-74c32ce9ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.265624 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af275ab-253a-47de-8a47-74c32ce9ca8b None admin] PATH_INFO: `/v3/users/27969228664649ed9665cfa9861d3064` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.266979 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af275ab-253a-47de-8a47-74c32ce9ca8b None admin] RBAC: Authorizing `identity:get_user(user_id=27969228664649ed9665cfa9861d3064)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:53.268883 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af275ab-253a-47de-8a47-74c32ce9ca8b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:53.271875 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 17/33] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:37:52 2022] GET /identity/v3/users/27969228664649ed9665cfa9861d3064 => generated 247 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:37:53.274342 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af275ab-253a-47de-8a47-74c32ce9ca8b None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:53.277532 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63416ba-4429-4b9c-848a-dbc21ff06334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:53.278584 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63416ba-4429-4b9c-848a-dbc21ff06334 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.278867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63416ba-4429-4b9c-848a-dbc21ff06334 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.279244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63416ba-4429-4b9c-848a-dbc21ff06334 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.281122 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63416ba-4429-4b9c-848a-dbc21ff06334 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:53.282748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63416ba-4429-4b9c-848a-dbc21ff06334 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:53.423131 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af275ab-253a-47de-8a47-74c32ce9ca8b None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:53.423745 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 17/34] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Aug 19 14:37:53 2022] POST /identity/v3/roles => generated 219 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:37:53.424761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63416ba-4429-4b9c-848a-dbc21ff06334 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:53.491327 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44711c-8caa-4622-b31a-d06b24be6f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:53.492845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44711c-8caa-4622-b31a-d06b24be6f9c None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.493755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44711c-8caa-4622-b31a-d06b24be6f9c None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.494418 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44711c-8caa-4622-b31a-d06b24be6f9c None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.495849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44711c-8caa-4622-b31a-d06b24be6f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:37:53.496452 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44711c-8caa-4622-b31a-d06b24be6f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:53.498518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44711c-8caa-4622-b31a-d06b24be6f9c None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:53.501987 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:53.525071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 18/35] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:37:53.526317 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44711c-8caa-4622-b31a-d06b24be6f9c None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:53.560557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63416ba-4429-4b9c-848a-dbc21ff06334 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:53.605969 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01d74f-0e9a-4cc7-9bd3-b9c7c753bc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:53.607034 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01d74f-0e9a-4cc7-9bd3-b9c7c753bc0a None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.607034 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01d74f-0e9a-4cc7-9bd3-b9c7c753bc0a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.607243 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01d74f-0e9a-4cc7-9bd3-b9c7c753bc0a None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.607959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01d74f-0e9a-4cc7-9bd3-b9c7c753bc0a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:53.609798 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01d74f-0e9a-4cc7-9bd3-b9c7c753bc0a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:53.635422 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 18/36] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Aug 19 14:37:53 2022] POST /identity/v3/roles => generated 225 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:37:53.635422 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc8f12-ee84-43b3-9905-134f98baab2d None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.635422 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc8f12-ee84-43b3-9905-134f98baab2d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.635422 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc8f12-ee84-43b3-9905-134f98baab2d None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.635422 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 19/37] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:37:53.636135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc8f12-ee84-43b3-9905-134f98baab2d None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:53.659964 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:53.698025 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44711c-8caa-4622-b31a-d06b24be6f9c None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:53.756809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c4dac-bf3d-4991-8863-7801e1592bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:53.758231 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c4dac-bf3d-4991-8863-7801e1592bf9 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.758950 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c4dac-bf3d-4991-8863-7801e1592bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.759388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c4dac-bf3d-4991-8863-7801e1592bf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.761238 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c4dac-bf3d-4991-8863-7801e1592bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:53.764114 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c4dac-bf3d-4991-8863-7801e1592bf9 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:53.766989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 19/38] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:37:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:37:53.768467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55904a4f-cc93-4819-be54-b70c3dc86584 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.768894 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55904a4f-cc93-4819-be54-b70c3dc86584 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.769302 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55904a4f-cc93-4819-be54-b70c3dc86584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.793607 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-55904a4f-cc93-4819-be54-b70c3dc86584 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:53.794347 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc8f12-ee84-43b3-9905-134f98baab2d None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:53.795676 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-55904a4f-cc93-4819-be54-b70c3dc86584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:53.856756 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639748d0-ff35-4ced-8186-13943852e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:53.857430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639748d0-ff35-4ced-8186-13943852e34b None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.857712 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639748d0-ff35-4ced-8186-13943852e34b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.858237 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639748d0-ff35-4ced-8186-13943852e34b None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.859186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639748d0-ff35-4ced-8186-13943852e34b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:53.860714 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639748d0-ff35-4ced-8186-13943852e34b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:53.892525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:53.901036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 20/39] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 14:37:53 2022] POST /identity/v3/projects => generated 301 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:37:53.902092 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639748d0-ff35-4ced-8186-13943852e34b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:53.908358 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 20/40] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:37:53.911211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddcde9-d78d-40b8-b95b-efdd35bf134d None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.912163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddcde9-d78d-40b8-b95b-efdd35bf134d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.913214 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddcde9-d78d-40b8-b95b-efdd35bf134d None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.918781 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 21/41] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:37:53.926173 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dcf90-df4a-4ba6-8a42-92ca5bed345f None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:53.926609 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dcf90-df4a-4ba6-8a42-92ca5bed345f None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:53.927049 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dcf90-df4a-4ba6-8a42-92ca5bed345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:53.954197 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-c53dcf90-df4a-4ba6-8a42-92ca5bed345f None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:53.955619 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-c53dcf90-df4a-4ba6-8a42-92ca5bed345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:53.988415 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:54.049320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639748d0-ff35-4ced-8186-13943852e34b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:54.068385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 22/42] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:37:54.092446 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1cfdf-72bc-4fd3-9910-f67929035f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:54.093378 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1cfdf-72bc-4fd3-9910-f67929035f57 None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:54.093851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1cfdf-72bc-4fd3-9910-f67929035f57 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:54.094369 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1cfdf-72bc-4fd3-9910-f67929035f57 None admin] PATH_INFO: `/v3/domains/default/users/27969228664649ed9665cfa9861d3064/roles/d444334199c640a7af820f46e283d49d` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:54.097081 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1cfdf-72bc-4fd3-9910-f67929035f57 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=27969228664649ed9665cfa9861d3064, role_id=d444334199c640a7af820f46e283d49d)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:54.098818 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1cfdf-72bc-4fd3-9910-f67929035f57 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:54.119541 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 21/43] 10.222.0.60 () {58 vars in 1361 bytes} [Fri Aug 19 14:37:53 2022] PUT /identity/v3/domains/default/users/27969228664649ed9665cfa9861d3064/roles/d444334199c640a7af820f46e283d49d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:37:54.280324 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dcf90-df4a-4ba6-8a42-92ca5bed345f None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:54.408859 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dcf90-df4a-4ba6-8a42-92ca5bed345f None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:54.416022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1cfdf-72bc-4fd3-9910-f67929035f57 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:54.437147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:54.451820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1a5c0-6574-4817-bddc-536402c7d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:54.452451 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1a5c0-6574-4817-bddc-536402c7d5bc None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:54.452724 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1a5c0-6574-4817-bddc-536402c7d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:54.452990 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1a5c0-6574-4817-bddc-536402c7d5bc None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:54.453687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1a5c0-6574-4817-bddc-536402c7d5bc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:54.455219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1a5c0-6574-4817-bddc-536402c7d5bc None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:54.535366 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1cfdf-72bc-4fd3-9910-f67929035f57 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:54.557332 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:54.577839 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54871dff-7fd5-4375-b630-f3c2e4379e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:54.578597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871dff-7fd5-4375-b630-f3c2e4379e13 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:54.578877 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871dff-7fd5-4375-b630-f3c2e4379e13 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:54.579156 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871dff-7fd5-4375-b630-f3c2e4379e13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:54.580381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54871dff-7fd5-4375-b630-f3c2e4379e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:54.581936 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54871dff-7fd5-4375-b630-f3c2e4379e13 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:54.583918 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 22/44] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:37:54.585838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 23/45] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Aug 19 14:37:54 2022] POST /identity/v3/roles => generated 223 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:37:54.590520 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54871dff-7fd5-4375-b630-f3c2e4379e13 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:54.723559 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54871dff-7fd5-4375-b630-f3c2e4379e13 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:54.769315 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92772224-6cdc-46c3-a488-bba1c38eb52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:54.770014 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772224-6cdc-46c3-a488-bba1c38eb52f None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:54.770264 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772224-6cdc-46c3-a488-bba1c38eb52f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:54.770537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772224-6cdc-46c3-a488-bba1c38eb52f None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:54.771194 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92772224-6cdc-46c3-a488-bba1c38eb52f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:54.772692 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92772224-6cdc-46c3-a488-bba1c38eb52f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:54.807222 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 14:37:54 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:37:56.483702 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e378c-4238-4831-9817-59198c70af26 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:56.484225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e378c-4238-4831-9817-59198c70af26 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:56.484225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e378c-4238-4831-9817-59198c70af26 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:56.485569 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:37:56.491452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd90e-afca-47aa-8e03-5a40ed52b2c8 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:56.491930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd90e-afca-47aa-8e03-5a40ed52b2c8 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:56.492030 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd90e-afca-47aa-8e03-5a40ed52b2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:56.512961 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-a60cd90e-afca-47aa-8e03-5a40ed52b2c8 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:56.514576 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-a60cd90e-afca-47aa-8e03-5a40ed52b2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:56.553833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:56.597211 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:37:56.961056 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e378c-4238-4831-9817-59198c70af26 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:57.061186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13777b9-959e-4429-8402-7d77d22b95cb None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:57.061767 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13777b9-959e-4429-8402-7d77d22b95cb None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:57.062226 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13777b9-959e-4429-8402-7d77d22b95cb None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:57.064797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 25/49] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:37:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:37:57.071129 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedea37-4752-4b27-9d95-8cf166907a2d None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:57.072283 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedea37-4752-4b27-9d95-8cf166907a2d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:57.072283 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedea37-4752-4b27-9d95-8cf166907a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:57.091293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e378c-4238-4831-9817-59198c70af26 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:57.094262 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-9bedea37-4752-4b27-9d95-8cf166907a2d None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:37:57.095575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-9bedea37-4752-4b27-9d95-8cf166907a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:37:57.130416 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6775f51-2555-4886-af58-fdb38a0abc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:57.131212 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6775f51-2555-4886-af58-fdb38a0abc32 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:57.131308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6775f51-2555-4886-af58-fdb38a0abc32 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:57.131586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6775f51-2555-4886-af58-fdb38a0abc32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:57.142884 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6775f51-2555-4886-af58-fdb38a0abc32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-f6775f51-2555-4886-af58-fdb38a0abc32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:37:57.147936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:37:57.148755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:37:57.149485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 25/50] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:37:57.157626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6775f51-2555-4886-af58-fdb38a0abc32 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:57.176259 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 26/51] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:37:57.204305 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:57.265205 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6775f51-2555-4886-af58-fdb38a0abc32 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:57.305545 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486c64c-fae1-48e9-a94b-2af8597b682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:57.306196 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486c64c-fae1-48e9-a94b-2af8597b682e None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:57.306472 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486c64c-fae1-48e9-a94b-2af8597b682e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:57.306769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486c64c-fae1-48e9-a94b-2af8597b682e None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:57.307613 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486c64c-fae1-48e9-a94b-2af8597b682e None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:37:57.308230 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486c64c-fae1-48e9-a94b-2af8597b682e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:57.309647 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486c64c-fae1-48e9-a94b-2af8597b682e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:57.320112 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 26/52] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:37:57.326686 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedea37-4752-4b27-9d95-8cf166907a2d None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:57.439871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:57.443363 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedea37-4752-4b27-9d95-8cf166907a2d None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:57.478884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b9d18-97cb-4d93-bb42-d050fe641a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:57.479531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b9d18-97cb-4d93-bb42-d050fe641a05 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:57.480019 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b9d18-97cb-4d93-bb42-d050fe641a05 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:57.480350 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b9d18-97cb-4d93-bb42-d050fe641a05 None admin] PATH_INFO: `/v3/users/27969228664649ed9665cfa9861d3064` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:57.481603 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b9d18-97cb-4d93-bb42-d050fe641a05 None admin] RBAC: Authorizing `identity:get_user(user_id=27969228664649ed9665cfa9861d3064)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:57.483151 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b9d18-97cb-4d93-bb42-d050fe641a05 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:57.484744 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 27/53] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:37:57 2022] GET /identity/v3/users/27969228664649ed9665cfa9861d3064 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:37:57.490594 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486c64c-fae1-48e9-a94b-2af8597b682e None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:57.527596 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b9d18-97cb-4d93-bb42-d050fe641a05 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:57.598137 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486c64c-fae1-48e9-a94b-2af8597b682e None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:57.601107 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:57.636701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0b2f-de22-4b26-8963-9ffbd44eb6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:57.637090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b9d18-97cb-4d93-bb42-d050fe641a05 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:57.637374 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0b2f-de22-4b26-8963-9ffbd44eb6e0 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:57.637617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0b2f-de22-4b26-8963-9ffbd44eb6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:57.637951 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0b2f-de22-4b26-8963-9ffbd44eb6e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:57.639218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc0b2f-de22-4b26-8963-9ffbd44eb6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:57.640801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc0b2f-de22-4b26-8963-9ffbd44eb6e0 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:57.642544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 27/54] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:37:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:37:57.648709 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0b2f-de22-4b26-8963-9ffbd44eb6e0 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:57.674384 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebd391-1b8d-4c3c-bde1-1e876be05e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:57.675268 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebd391-1b8d-4c3c-bde1-1e876be05e28 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:57.675697 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebd391-1b8d-4c3c-bde1-1e876be05e28 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:57.676010 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebd391-1b8d-4c3c-bde1-1e876be05e28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:57.677222 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebd391-1b8d-4c3c-bde1-1e876be05e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:57.678859 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebd391-1b8d-4c3c-bde1-1e876be05e28 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:57.680488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 28/55] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:37:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:37:57.688068 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebd391-1b8d-4c3c-bde1-1e876be05e28 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:37:57.727576 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:37:57.763937 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0b2f-de22-4b26-8963-9ffbd44eb6e0 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:57.801390 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c532c8-360b-465d-9da7-32a0a8996981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:57.802021 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c532c8-360b-465d-9da7-32a0a8996981 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:57.802429 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c532c8-360b-465d-9da7-32a0a8996981 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:57.802708 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c532c8-360b-465d-9da7-32a0a8996981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:57.803447 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c532c8-360b-465d-9da7-32a0a8996981 None admin] RBAC: Adding query filter params (role.id=d444334199c640a7af820f46e283d49d, scope.domain.id=default, user.id=27969228664649ed9665cfa9861d3064) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:37:57.803816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c532c8-360b-465d-9da7-32a0a8996981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:57.805307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c532c8-360b-465d-9da7-32a0a8996981 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:57.805801 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebd391-1b8d-4c3c-bde1-1e876be05e28 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:37:57.812386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 28/56] 10.222.0.60 () {56 vars in 1322 bytes} [Fri Aug 19 14:37:57 2022] GET /identity/v3/role_assignments?user.id=27969228664649ed9665cfa9861d3064&scope.domain.id=default&role.id=d444334199c640a7af820f46e283d49d => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:37:57.850023 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fe15b-82ce-454c-be70-90d1e97d3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:37:57.850681 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe15b-82ce-454c-be70-90d1e97d3d29 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:37:57.850958 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe15b-82ce-454c-be70-90d1e97d3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:37:57.851222 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe15b-82ce-454c-be70-90d1e97d3d29 None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:37:57.851863 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fe15b-82ce-454c-be70-90d1e97d3d29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:37:57.853363 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fe15b-82ce-454c-be70-90d1e97d3d29 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:37:57.884724 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 29/57] 10.222.0.60 () {60 vars in 1140 bytes} [Fri Aug 19 14:37:57 2022] POST /identity/v3/projects => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:00.146800 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf0e6-80de-4529-aac6-4adad6b0f4e5 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:00.147341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf0e6-80de-4529-aac6-4adad6b0f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:00.147341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf0e6-80de-4529-aac6-4adad6b0f4e5 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:00.148642 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 29/58] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:00.154084 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8361-0c94-4366-aeca-dc778d8527ab None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:00.154505 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8361-0c94-4366-aeca-dc778d8527ab None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:00.154701 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8361-0c94-4366-aeca-dc778d8527ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:00.174209 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-ffca8361-0c94-4366-aeca-dc778d8527ab None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:00.175406 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-ffca8361-0c94-4366-aeca-dc778d8527ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:00.246255 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 30/59] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:00.568281 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf0e6-80de-4529-aac6-4adad6b0f4e5 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:00.607649 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:00.679031 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf0e6-80de-4529-aac6-4adad6b0f4e5 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:00.719410 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94809180-a63f-4fe1-b441-5925fc7206b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:00.720052 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94809180-a63f-4fe1-b441-5925fc7206b7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:00.720322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94809180-a63f-4fe1-b441-5925fc7206b7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:00.720590 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94809180-a63f-4fe1-b441-5925fc7206b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:00.721777 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94809180-a63f-4fe1-b441-5925fc7206b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:00.723339 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94809180-a63f-4fe1-b441-5925fc7206b7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:00.724991 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 30/60] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:38:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:00.731110 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8361-0c94-4366-aeca-dc778d8527ab None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:00.750377 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:00.839374 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8361-0c94-4366-aeca-dc778d8527ab None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:00.882949 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3a28a-7c9d-4ed5-9271-336b1bb78db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:00.883564 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3a28a-7c9d-4ed5-9271-336b1bb78db9 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:00.883837 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3a28a-7c9d-4ed5-9271-336b1bb78db9 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:00.884106 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3a28a-7c9d-4ed5-9271-336b1bb78db9 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:00.884745 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3a28a-7c9d-4ed5-9271-336b1bb78db9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:00.886525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3a28a-7c9d-4ed5-9271-336b1bb78db9 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:00.914732 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 31/61] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:38:00 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:04.504769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a456f68-8e9a-4229-a189-88f349ec4e13 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:04.504769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a456f68-8e9a-4229-a189-88f349ec4e13 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:04.504769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a456f68-8e9a-4229-a189-88f349ec4e13 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:04.504769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 31/62] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:04.511414 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011565f-3de8-4bc1-acca-f88d41e43ce9 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:04.512563 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011565f-3de8-4bc1-acca-f88d41e43ce9 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:04.513044 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011565f-3de8-4bc1-acca-f88d41e43ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:04.532641 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-c011565f-3de8-4bc1-acca-f88d41e43ce9 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:04.534273 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c011565f-3de8-4bc1-acca-f88d41e43ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:04.622527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 32/63] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:04.648467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d6d32-b064-4ac5-a22e-a77408948545 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:04.649188 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d6d32-b064-4ac5-a22e-a77408948545 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:04.649659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d6d32-b064-4ac5-a22e-a77408948545 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:04.651244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 32/64] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:04.657090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66592c3b-dfcb-4458-9e6d-b692b94d5f30 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:04.657689 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66592c3b-dfcb-4458-9e6d-b692b94d5f30 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:04.658441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66592c3b-dfcb-4458-9e6d-b692b94d5f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:04.671274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:04.685699 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-66592c3b-dfcb-4458-9e6d-b692b94d5f30 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:04.687034 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-66592c3b-dfcb-4458-9e6d-b692b94d5f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:04.778359 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 33/65] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:04.938107 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436dd6e-0f72-46b9-ab2d-18bce72f5176 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:04.938770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436dd6e-0f72-46b9-ab2d-18bce72f5176 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:04.939566 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436dd6e-0f72-46b9-ab2d-18bce72f5176 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:04.941168 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 33/66] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:04.949985 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12d0b-cd63-473f-aed1-4a98985d9878 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:04.950963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12d0b-cd63-473f-aed1-4a98985d9878 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:04.951446 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12d0b-cd63-473f-aed1-4a98985d9878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:04.973645 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-c6f12d0b-cd63-473f-aed1-4a98985d9878 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:04.975166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c6f12d0b-cd63-473f-aed1-4a98985d9878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:05.054365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 34/67] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:05.139153 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436dd6e-0f72-46b9-ab2d-18bce72f5176 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:05.170143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12d0b-cd63-473f-aed1-4a98985d9878 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:05.243386 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:05.307940 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436dd6e-0f72-46b9-ab2d-18bce72f5176 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:05.311805 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:05.319985 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12d0b-cd63-473f-aed1-4a98985d9878 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:05.352950 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56a6d8-309c-40ab-98a4-8827349d7445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:05.353893 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56a6d8-309c-40ab-98a4-8827349d7445 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:05.354415 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56a6d8-309c-40ab-98a4-8827349d7445 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:05.355583 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56a6d8-309c-40ab-98a4-8827349d7445 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:05.362248 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4692bb3-281b-489b-8056-bcf2a0f4b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:05.363141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4692bb3-281b-489b-8056-bcf2a0f4b8bf None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:05.363715 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4692bb3-281b-489b-8056-bcf2a0f4b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:05.364124 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4692bb3-281b-489b-8056-bcf2a0f4b8bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:05.375824 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56a6d8-309c-40ab-98a4-8827349d7445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:05.381892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4692bb3-281b-489b-8056-bcf2a0f4b8bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-4f56a6d8-309c-40ab-98a4-8827349d7445 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:05.387318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:05.388385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:05.389328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:05.390551 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 34/68] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:05.391858 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c7d1-7640-45f0-a017-086cda6524f5 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:05.392212 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c7d1-7640-45f0-a017-086cda6524f5 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:05.392553 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c7d1-7640-45f0-a017-086cda6524f5 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:05.394063 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 35/69] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-c4692bb3-281b-489b-8056-bcf2a0f4b8bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:05.394558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:05.395478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:05.396319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:05.398257 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 35/70] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:05.398915 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252c7d1-7640-45f0-a017-086cda6524f5 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:05.400015 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9da75-92e2-4cf5-b8ef-1000ea0eed24 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:05.400455 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9da75-92e2-4cf5-b8ef-1000ea0eed24 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:05.400886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9da75-92e2-4cf5-b8ef-1000ea0eed24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:05.426556 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-15d9da75-92e2-4cf5-b8ef-1000ea0eed24 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:05.427771 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-15d9da75-92e2-4cf5-b8ef-1000ea0eed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:05.514735 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 36/71] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:05.515414 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9da75-92e2-4cf5-b8ef-1000ea0eed24 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:05.524577 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252c7d1-7640-45f0-a017-086cda6524f5 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:05.562255 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e26bc-38f6-4e6b-9963-ae2881680004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:05.562898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e26bc-38f6-4e6b-9963-ae2881680004 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:05.563140 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e26bc-38f6-4e6b-9963-ae2881680004 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:05.563406 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e26bc-38f6-4e6b-9963-ae2881680004 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:05.564391 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e26bc-38f6-4e6b-9963-ae2881680004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:05.564677 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e26bc-38f6-4e6b-9963-ae2881680004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:05.566157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e26bc-38f6-4e6b-9963-ae2881680004 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:05.577133 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 36/72] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:05.578392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837e82-ca3f-4697-8f72-b1420b6a06be None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:05.578676 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837e82-ca3f-4697-8f72-b1420b6a06be None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:05.578941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837e82-ca3f-4697-8f72-b1420b6a06be None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:05.584183 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 37/73] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:05.584183 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8837e82-ca3f-4697-8f72-b1420b6a06be None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:05.584398 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:05.616367 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:05.646035 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9da75-92e2-4cf5-b8ef-1000ea0eed24 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:05.689806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd65e2f-5586-4bbd-b9ec-fd94190f4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:05.690459 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd65e2f-5586-4bbd-b9ec-fd94190f4234 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:05.690735 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd65e2f-5586-4bbd-b9ec-fd94190f4234 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:05.691029 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd65e2f-5586-4bbd-b9ec-fd94190f4234 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:05.691697 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd65e2f-5586-4bbd-b9ec-fd94190f4234 None admin] RBAC: Adding query filter params (name=member) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:05.692004 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd65e2f-5586-4bbd-b9ec-fd94190f4234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:05.693376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd65e2f-5586-4bbd-b9ec-fd94190f4234 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:05.710859 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 37/74] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:05.710859 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd65e2f-5586-4bbd-b9ec-fd94190f4234 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:05.713036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8837e82-ca3f-4697-8f72-b1420b6a06be None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:05.756345 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb991-6e9f-455a-8792-4b41cfca0288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:05.756987 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb991-6e9f-455a-8792-4b41cfca0288 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:05.757269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb991-6e9f-455a-8792-4b41cfca0288 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:05.757543 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb991-6e9f-455a-8792-4b41cfca0288 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:05.769242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb991-6e9f-455a-8792-4b41cfca0288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-307eb991-6e9f-455a-8792-4b41cfca0288 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:05.774011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:05.774889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:05.775646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 38/75] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:38:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:05.777323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1437cc-bec8-4189-9f1f-c2d0aa69fa73 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:05.777323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1437cc-bec8-4189-9f1f-c2d0aa69fa73 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:05.777323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1437cc-bec8-4189-9f1f-c2d0aa69fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:05.802303 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-8c1437cc-bec8-4189-9f1f-c2d0aa69fa73 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:05.803900 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-8c1437cc-bec8-4189-9f1f-c2d0aa69fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:05.830901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd65e2f-5586-4bbd-b9ec-fd94190f4234 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:05.849026 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:05.871936 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbcfe6-7bd2-40af-a2e1-9a282e127e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:05.872562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbcfe6-7bd2-40af-a2e1-9a282e127e3d None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:05.872840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbcfe6-7bd2-40af-a2e1-9a282e127e3d None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:05.873127 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbcfe6-7bd2-40af-a2e1-9a282e127e3d None admin] PATH_INFO: `/v3/users/27969228664649ed9665cfa9861d3064` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:05.874391 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbcfe6-7bd2-40af-a2e1-9a282e127e3d None admin] RBAC: Authorizing `identity:get_user(user_id=27969228664649ed9665cfa9861d3064)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:05.875938 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbcfe6-7bd2-40af-a2e1-9a282e127e3d None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:05.877467 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 38/76] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:05 2022] GET /identity/v3/users/27969228664649ed9665cfa9861d3064 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:05.882631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 39/77] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:05.882740 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbcfe6-7bd2-40af-a2e1-9a282e127e3d None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:05.882857 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1437cc-bec8-4189-9f1f-c2d0aa69fa73 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:05.905936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:05.991411 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbcfe6-7bd2-40af-a2e1-9a282e127e3d None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:06.006079 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1437cc-bec8-4189-9f1f-c2d0aa69fa73 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:06.031184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec647fa-2d8c-4628-a50c-c5e7d2ba7da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:06.031916 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec647fa-2d8c-4628-a50c-c5e7d2ba7da8 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:06.032387 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec647fa-2d8c-4628-a50c-c5e7d2ba7da8 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:06.032939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec647fa-2d8c-4628-a50c-c5e7d2ba7da8 None admin] PATH_INFO: `/v3/users/e8676f826bd04492bdb84c50b42a20be` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:06.048428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d89a2-ee58-4ec2-9ac8-45cb6f1fe269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:06.049317 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d89a2-ee58-4ec2-9ac8-45cb6f1fe269 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:06.049776 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d89a2-ee58-4ec2-9ac8-45cb6f1fe269 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:06.050185 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d89a2-ee58-4ec2-9ac8-45cb6f1fe269 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:06.050490 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec647fa-2d8c-4628-a50c-c5e7d2ba7da8 None admin] RBAC: Authorizing `identity:get_user(user_id=e8676f826bd04492bdb84c50b42a20be)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:06.051112 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d89a2-ee58-4ec2-9ac8-45cb6f1fe269 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:06.051526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d89a2-ee58-4ec2-9ac8-45cb6f1fe269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:06.052136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec647fa-2d8c-4628-a50c-c5e7d2ba7da8 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:06.053168 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d89a2-ee58-4ec2-9ac8-45cb6f1fe269 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:06.054060 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 39/78] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:05 2022] GET /identity/v3/users/e8676f826bd04492bdb84c50b42a20be => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:06.054602 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec647fa-2d8c-4628-a50c-c5e7d2ba7da8 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:06.070060 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 40/79] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:38:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:06.070060 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d89a2-ee58-4ec2-9ac8-45cb6f1fe269 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:06.122507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:06.169864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:06.196129 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec647fa-2d8c-4628-a50c-c5e7d2ba7da8 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:06.201533 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d89a2-ee58-4ec2-9ac8-45cb6f1fe269 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:06.240229 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81a66c-073b-4256-8862-9993e663adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:06.240906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81a66c-073b-4256-8862-9993e663adf3 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:06.241186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81a66c-073b-4256-8862-9993e663adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:06.241460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81a66c-073b-4256-8862-9993e663adf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:06.246460 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983de6b-26e3-4565-85ed-2cc1629e2fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:06.247152 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983de6b-26e3-4565-85ed-2cc1629e2fd2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:06.247505 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983de6b-26e3-4565-85ed-2cc1629e2fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:06.247903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983de6b-26e3-4565-85ed-2cc1629e2fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:06.252529 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81a66c-073b-4256-8862-9993e663adf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-7b81a66c-073b-4256-8862-9993e663adf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:06.257428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:06.258473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 40/80] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:06.263109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81a66c-073b-4256-8862-9993e663adf3 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:06.322702 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983de6b-26e3-4565-85ed-2cc1629e2fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:06.324167 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983de6b-26e3-4565-85ed-2cc1629e2fd2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:06.366498 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81a66c-073b-4256-8862-9993e663adf3 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:06.368863 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:06.407778 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16eec77-fc62-43b4-8b94-1d891313ad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:06.408404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16eec77-fc62-43b4-8b94-1d891313ad0d None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:06.408510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:06.409134 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16eec77-fc62-43b4-8b94-1d891313ad0d None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:06.409134 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16eec77-fc62-43b4-8b94-1d891313ad0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:06.433646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 41/81] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:06.434539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983de6b-26e3-4565-85ed-2cc1629e2fd2 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:06.493212 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16eec77-fc62-43b4-8b94-1d891313ad0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:06.495541 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16eec77-fc62-43b4-8b94-1d891313ad0d None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:06.547674 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983de6b-26e3-4565-85ed-2cc1629e2fd2 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:06.587465 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8640b46-287b-48d6-96da-cc9005581b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:06.588346 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640b46-287b-48d6-96da-cc9005581b10 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:06.588614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640b46-287b-48d6-96da-cc9005581b10 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:06.589032 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8640b46-287b-48d6-96da-cc9005581b10 None admin] PATH_INFO: `/v3/users/e8676f826bd04492bdb84c50b42a20be` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:06.590372 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8640b46-287b-48d6-96da-cc9005581b10 None admin] RBAC: Authorizing `identity:get_user(user_id=e8676f826bd04492bdb84c50b42a20be)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:06.591809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8640b46-287b-48d6-96da-cc9005581b10 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:06.593431 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 42/82] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:06 2022] GET /identity/v3/users/e8676f826bd04492bdb84c50b42a20be => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:06.599037 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8640b46-287b-48d6-96da-cc9005581b10 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:06.606956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 41/83] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:06.608468 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16eec77-fc62-43b4-8b94-1d891313ad0d None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:06.613307 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:06.650318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:06.706823 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8640b46-287b-48d6-96da-cc9005581b10 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:06.720666 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16eec77-fc62-43b4-8b94-1d891313ad0d None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:06.743836 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ba244-2c8a-4160-842d-33778cf69fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:06.744473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ba244-2c8a-4160-842d-33778cf69fa6 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:06.744885 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ba244-2c8a-4160-842d-33778cf69fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:06.745108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ba244-2c8a-4160-842d-33778cf69fa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:06.747228 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ba244-2c8a-4160-842d-33778cf69fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:06.748696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ba244-2c8a-4160-842d-33778cf69fa6 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:06.750319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 43/84] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:06.751125 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ba244-2c8a-4160-842d-33778cf69fa6 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:06.759586 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeefc2-7f60-4984-953b-77139b59c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:06.760242 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeefc2-7f60-4984-953b-77139b59c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:06.760520 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeefc2-7f60-4984-953b-77139b59c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:06.760941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeefc2-7f60-4984-953b-77139b59c6d2 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:06.761670 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeefc2-7f60-4984-953b-77139b59c6d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:06.762133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeefc2-7f60-4984-953b-77139b59c6d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:06.763421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeefc2-7f60-4984-953b-77139b59c6d2 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:06.772323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 42/85] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:06.773142 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeefc2-7f60-4984-953b-77139b59c6d2 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:06.840549 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:06.865464 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ba244-2c8a-4160-842d-33778cf69fa6 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:06.881520 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:06.881688 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeefc2-7f60-4984-953b-77139b59c6d2 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:06.904322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e80b-fc73-42e7-aec0-a8770e39a8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:06.904968 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e80b-fc73-42e7-aec0-a8770e39a8af None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:06.905231 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e80b-fc73-42e7-aec0-a8770e39a8af None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:06.905538 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e80b-fc73-42e7-aec0-a8770e39a8af None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:06.906873 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20e80b-fc73-42e7-aec0-a8770e39a8af None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:06.908372 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20e80b-fc73-42e7-aec0-a8770e39a8af None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:06.910080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 44/86] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:06 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:06.910841 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e80b-fc73-42e7-aec0-a8770e39a8af None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:06.917706 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4417d-69c0-4f16-8ff4-32132f611a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:06.918415 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4417d-69c0-4f16-8ff4-32132f611a18 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:06.918677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4417d-69c0-4f16-8ff4-32132f611a18 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:06.918943 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4417d-69c0-4f16-8ff4-32132f611a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:06.993032 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4417d-69c0-4f16-8ff4-32132f611a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:06.994743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4417d-69c0-4f16-8ff4-32132f611a18 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:07.016606 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e80b-fc73-42e7-aec0-a8770e39a8af None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:07.051093 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b685bf-be0a-4326-95fb-0286731b9d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:07.051791 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b685bf-be0a-4326-95fb-0286731b9d5b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:07.052064 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b685bf-be0a-4326-95fb-0286731b9d5b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:07.052333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b685bf-be0a-4326-95fb-0286731b9d5b None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:07.053456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b685bf-be0a-4326-95fb-0286731b9d5b None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:07.054937 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b685bf-be0a-4326-95fb-0286731b9d5b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:07.056623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 45/87] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:06 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:07.057181 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:07.057342 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b685bf-be0a-4326-95fb-0286731b9d5b None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:07.098573 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 43/88] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:07.099465 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4417d-69c0-4f16-8ff4-32132f611a18 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:07.116629 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:07.175147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b685bf-be0a-4326-95fb-0286731b9d5b None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:07.216488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4417d-69c0-4f16-8ff4-32132f611a18 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:07.216696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76eb73-8f05-41a6-badd-d33b67edbf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:07.217392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76eb73-8f05-41a6-badd-d33b67edbf92 None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:07.217675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76eb73-8f05-41a6-badd-d33b67edbf92 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:07.218078 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76eb73-8f05-41a6-badd-d33b67edbf92 None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:07.218919 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76eb73-8f05-41a6-badd-d33b67edbf92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:07.220965 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76eb73-8f05-41a6-badd-d33b67edbf92 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:07.253198 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed95c-a35f-43c5-9940-1dbd926bd022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:07.254215 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed95c-a35f-43c5-9940-1dbd926bd022 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:07.254492 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed95c-a35f-43c5-9940-1dbd926bd022 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:07.254763 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed95c-a35f-43c5-9940-1dbd926bd022 None admin] PATH_INFO: `/v3/users/e8676f826bd04492bdb84c50b42a20be` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:07.255907 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ed95c-a35f-43c5-9940-1dbd926bd022 None admin] RBAC: Authorizing `identity:get_user(user_id=e8676f826bd04492bdb84c50b42a20be)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:07.256048 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 46/89] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:38:07 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:07.256759 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76eb73-8f05-41a6-badd-d33b67edbf92 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:07.257386 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ed95c-a35f-43c5-9940-1dbd926bd022 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:07.259277 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 44/90] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:07 2022] GET /identity/v3/users/e8676f826bd04492bdb84c50b42a20be => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:07.260145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed95c-a35f-43c5-9940-1dbd926bd022 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:07.323292 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:07.397642 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76eb73-8f05-41a6-badd-d33b67edbf92 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:07.410014 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:07.431559 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed95c-a35f-43c5-9940-1dbd926bd022 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:07.446844 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4dde-4bf0-4989-9a30-04bab60eed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:07.447471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4dde-4bf0-4989-9a30-04bab60eed58 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:07.447751 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4dde-4bf0-4989-9a30-04bab60eed58 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:07.448020 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4dde-4bf0-4989-9a30-04bab60eed58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:07.449246 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4dde-4bf0-4989-9a30-04bab60eed58 None admin] RBAC: Adding query filter params (role.id=d444334199c640a7af820f46e283d49d, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b, user.id=27969228664649ed9665cfa9861d3064) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:07.449593 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4dde-4bf0-4989-9a30-04bab60eed58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:07.452387 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4dde-4bf0-4989-9a30-04bab60eed58 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:07.463343 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 47/91] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:07 2022] GET /identity/v3/role_assignments?user.id=27969228664649ed9665cfa9861d3064&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=d444334199c640a7af820f46e283d49d => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:07.463343 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4dde-4bf0-4989-9a30-04bab60eed58 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:07.500410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3245c-55fa-4510-93a7-bbdff84591c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:07.501012 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3245c-55fa-4510-93a7-bbdff84591c1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:07.501295 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3245c-55fa-4510-93a7-bbdff84591c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:07.501580 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3245c-55fa-4510-93a7-bbdff84591c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:07.502405 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3245c-55fa-4510-93a7-bbdff84591c1 None admin] RBAC: Adding query filter params (role.id=d4bd126c45e24b93a90052154a32972b, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b, user.id=e8676f826bd04492bdb84c50b42a20be) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:07.502711 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3245c-55fa-4510-93a7-bbdff84591c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:07.504308 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3245c-55fa-4510-93a7-bbdff84591c1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:07.519344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 45/92] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:07 2022] GET /identity/v3/role_assignments?user.id=e8676f826bd04492bdb84c50b42a20be&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=d4bd126c45e24b93a90052154a32972b => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:07.519344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3245c-55fa-4510-93a7-bbdff84591c1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:07.623737 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4dde-4bf0-4989-9a30-04bab60eed58 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:07.680227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb96322-a33c-49bd-9c70-63661ab5160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:07.680823 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb96322-a33c-49bd-9c70-63661ab5160a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:07.681103 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb96322-a33c-49bd-9c70-63661ab5160a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:07.681383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb96322-a33c-49bd-9c70-63661ab5160a None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:07.681902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:07.682855 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb96322-a33c-49bd-9c70-63661ab5160a None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:07.684897 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb96322-a33c-49bd-9c70-63661ab5160a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:07.686603 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 48/93] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:07 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:07.691555 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3245c-55fa-4510-93a7-bbdff84591c1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:07.694127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb96322-a33c-49bd-9c70-63661ab5160a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:07.750366 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055248d6-3f1d-45aa-8c65-c5be6cd37028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:07.751057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055248d6-3f1d-45aa-8c65-c5be6cd37028 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:07.751440 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055248d6-3f1d-45aa-8c65-c5be6cd37028 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:07.751721 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055248d6-3f1d-45aa-8c65-c5be6cd37028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:07.762732 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:07.873068 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb96322-a33c-49bd-9c70-63661ab5160a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:07.887186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055248d6-3f1d-45aa-8c65-c5be6cd37028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:07.889558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055248d6-3f1d-45aa-8c65-c5be6cd37028 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:07.925698 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a740ec0-1cdc-4187-b0b4-d7a3852b9850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:07.926344 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a740ec0-1cdc-4187-b0b4-d7a3852b9850 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:07.926619 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a740ec0-1cdc-4187-b0b4-d7a3852b9850 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:07.926886 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a740ec0-1cdc-4187-b0b4-d7a3852b9850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:07.927619 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a740ec0-1cdc-4187-b0b4-d7a3852b9850 None admin] RBAC: Adding query filter params (role.id=d3126a0397e243eeb3aa834efbabf407, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b, user.id=e8676f826bd04492bdb84c50b42a20be) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:07.927923 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a740ec0-1cdc-4187-b0b4-d7a3852b9850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:07.929465 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a740ec0-1cdc-4187-b0b4-d7a3852b9850 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:07.954145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 49/94] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:07 2022] GET /identity/v3/role_assignments?user.id=e8676f826bd04492bdb84c50b42a20be&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=d3126a0397e243eeb3aa834efbabf407 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:08.037184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:08.044600 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 46/95] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:08.050842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a740ec0-1cdc-4187-b0b4-d7a3852b9850 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:08.190528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a740ec0-1cdc-4187-b0b4-d7a3852b9850 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:08.192434 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:08.252377 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeccb45-e339-40e9-a2c2-d5f1e0131be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:08.253053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeccb45-e339-40e9-a2c2-d5f1e0131be0 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:08.253435 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeccb45-e339-40e9-a2c2-d5f1e0131be0 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:08.253720 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeccb45-e339-40e9-a2c2-d5f1e0131be0 None admin] PATH_INFO: `/v3/projects/c67c7c49a672495e81a9cd13125938de` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:08.255243 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeccb45-e339-40e9-a2c2-d5f1e0131be0 None admin] RBAC: Authorizing `identity:get_project(project_id=c67c7c49a672495e81a9cd13125938de)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:08.257052 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeccb45-e339-40e9-a2c2-d5f1e0131be0 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:08.263596 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 50/96] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:08 2022] GET /identity/v3/projects/c67c7c49a672495e81a9cd13125938de => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:08.270313 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055248d6-3f1d-45aa-8c65-c5be6cd37028 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:08.428316 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055248d6-3f1d-45aa-8c65-c5be6cd37028 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:08.478175 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065907a-7f42-46dd-8fe8-c30168ef884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:08.478805 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065907a-7f42-46dd-8fe8-c30168ef884b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:08.479089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065907a-7f42-46dd-8fe8-c30168ef884b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:08.479489 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065907a-7f42-46dd-8fe8-c30168ef884b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:08.480566 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065907a-7f42-46dd-8fe8-c30168ef884b None admin] RBAC: Adding query filter params (role.id=d4bd126c45e24b93a90052154a32972b, scope.project.id=c67c7c49a672495e81a9cd13125938de, user.id=e8676f826bd04492bdb84c50b42a20be) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:08.481124 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065907a-7f42-46dd-8fe8-c30168ef884b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:08.482759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065907a-7f42-46dd-8fe8-c30168ef884b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:08.494792 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 47/97] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:08 2022] GET /identity/v3/role_assignments?user.id=e8676f826bd04492bdb84c50b42a20be&scope.project.id=c67c7c49a672495e81a9cd13125938de&role.id=d4bd126c45e24b93a90052154a32972b => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:10.634934 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917571e-78a6-4d88-9e96-d3ef77ed0f28 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:10.635470 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917571e-78a6-4d88-9e96-d3ef77ed0f28 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:10.635470 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917571e-78a6-4d88-9e96-d3ef77ed0f28 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:10.636927 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 51/98] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:38:10.652030 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b0052-7d94-497c-9fa0-a868676ead03 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:10.652559 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b0052-7d94-497c-9fa0-a868676ead03 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:10.652871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b0052-7d94-497c-9fa0-a868676ead03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:10.680006 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-1e1b0052-7d94-497c-9fa0-a868676ead03 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:10.681242 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-1e1b0052-7d94-497c-9fa0-a868676ead03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:10.754425 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:10.769082 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 48/99] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:10.970131 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05255e1b-eac4-44ab-a50b-1313f21ed648 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:10.970320 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05255e1b-eac4-44ab-a50b-1313f21ed648 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:10.970588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05255e1b-eac4-44ab-a50b-1313f21ed648 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:10.971944 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 52/100] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:10.978154 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc3b5-51ae-4dc4-8ef6-599aa8d29290 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:10.978473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc3b5-51ae-4dc4-8ef6-599aa8d29290 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:10.978718 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc3b5-51ae-4dc4-8ef6-599aa8d29290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:11.002481 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-6b5dc3b5-51ae-4dc4-8ef6-599aa8d29290 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:11.003728 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-6b5dc3b5-51ae-4dc4-8ef6-599aa8d29290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:11.098602 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 49/101] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:11.271420 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331c51-37bb-424b-86bd-cb5871d513cf None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:11.272109 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331c51-37bb-424b-86bd-cb5871d513cf None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:11.272594 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331c51-37bb-424b-86bd-cb5871d513cf None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:11.274191 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 53/102] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:11.281854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352487cf-69ed-4e10-955b-6fc99984e79a None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:11.282790 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352487cf-69ed-4e10-955b-6fc99984e79a None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:11.283485 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352487cf-69ed-4e10-955b-6fc99984e79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:11.312525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-352487cf-69ed-4e10-955b-6fc99984e79a None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:11.314479 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-352487cf-69ed-4e10-955b-6fc99984e79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:11.340255 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331c51-37bb-424b-86bd-cb5871d513cf None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:11.423460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 50/103] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:11.434193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861428c5-52f6-4396-8efe-14a67a28f6a5 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:11.434193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861428c5-52f6-4396-8efe-14a67a28f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:11.434193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861428c5-52f6-4396-8efe-14a67a28f6a5 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:11.434193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 51/104] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:11.450554 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab493f-ffbc-4a86-8fa5-7a75149b7e3f None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:11.450888 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab493f-ffbc-4a86-8fa5-7a75149b7e3f None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:11.451095 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab493f-ffbc-4a86-8fa5-7a75149b7e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:11.498648 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-d2ab493f-ffbc-4a86-8fa5-7a75149b7e3f None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:11.499865 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-d2ab493f-ffbc-4a86-8fa5-7a75149b7e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:11.603348 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331c51-37bb-424b-86bd-cb5871d513cf None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:11.619374 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:11.621523 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 52/105] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:38:11.622883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f73c8-a74b-45df-b682-6b316890a8b2 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:11.623168 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f73c8-a74b-45df-b682-6b316890a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:11.623444 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f73c8-a74b-45df-b682-6b316890a8b2 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:11.624742 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 53/106] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:11.632406 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac161e-d875-49ce-9ac7-177b2a456d98 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:11.632694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac161e-d875-49ce-9ac7-177b2a456d98 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:11.632960 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac161e-d875-49ce-9ac7-177b2a456d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:11.669146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-c8ac161e-d875-49ce-9ac7-177b2a456d98 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:11.670421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c8ac161e-d875-49ce-9ac7-177b2a456d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:11.702663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89412cd9-4f6f-467a-8bbb-eede9e7a696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:11.703381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412cd9-4f6f-467a-8bbb-eede9e7a696d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:11.703702 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412cd9-4f6f-467a-8bbb-eede9e7a696d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:11.704078 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412cd9-4f6f-467a-8bbb-eede9e7a696d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:11.734132 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89412cd9-4f6f-467a-8bbb-eede9e7a696d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-89412cd9-4f6f-467a-8bbb-eede9e7a696d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:11.742812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:11.743744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:11.744541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:11.756796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 54/107] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:38:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:38:11.757881 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89412cd9-4f6f-467a-8bbb-eede9e7a696d None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:11.824595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 54/108] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:11.827193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac161e-d875-49ce-9ac7-177b2a456d98 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:11.831938 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:11.986981 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89412cd9-4f6f-467a-8bbb-eede9e7a696d None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.007467 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac161e-d875-49ce-9ac7-177b2a456d98 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.026336 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:12.027400 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa5c44-0bde-4e70-944c-555cbcf4c650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.028133 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa5c44-0bde-4e70-944c-555cbcf4c650 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.028475 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa5c44-0bde-4e70-944c-555cbcf4c650 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.028808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa5c44-0bde-4e70-944c-555cbcf4c650 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.040604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa5c44-0bde-4e70-944c-555cbcf4c650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-6efa5c44-0bde-4e70-944c-555cbcf4c650 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:12.045849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:12.046729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:12.047498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 55/109] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:38:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:12.048128 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa5c44-0bde-4e70-944c-555cbcf4c650 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.059323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3b71-a140-4b09-b6d8-41f4bc51d800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.060023 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3b71-a140-4b09-b6d8-41f4bc51d800 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.060308 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3b71-a140-4b09-b6d8-41f4bc51d800 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.060641 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3b71-a140-4b09-b6d8-41f4bc51d800 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.061381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f3b71-a140-4b09-b6d8-41f4bc51d800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:12.061743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f3b71-a140-4b09-b6d8-41f4bc51d800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:12.063255 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f3b71-a140-4b09-b6d8-41f4bc51d800 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:12.075739 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 55/110] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:12.076622 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3b71-a140-4b09-b6d8-41f4bc51d800 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.160556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:12.173938 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa5c44-0bde-4e70-944c-555cbcf4c650 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.199945 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3b71-a140-4b09-b6d8-41f4bc51d800 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.214763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683766-8403-4bef-b60e-68d7659cecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.215502 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683766-8403-4bef-b60e-68d7659cecd0 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.215841 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683766-8403-4bef-b60e-68d7659cecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.216176 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683766-8403-4bef-b60e-68d7659cecd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.227781 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39683766-8403-4bef-b60e-68d7659cecd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-39683766-8403-4bef-b60e-68d7659cecd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:12.232828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:12.234617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:12.236275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 56/111] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:12.242109 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683766-8403-4bef-b60e-68d7659cecd0 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.247640 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f6e7e-4245-4d4a-a0b1-99289271d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.248586 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f6e7e-4245-4d4a-a0b1-99289271d0ce None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.248873 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f6e7e-4245-4d4a-a0b1-99289271d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.249150 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f6e7e-4245-4d4a-a0b1-99289271d0ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.263362 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f6e7e-4245-4d4a-a0b1-99289271d0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-850f6e7e-4245-4d4a-a0b1-99289271d0ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:12.270963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:12.272076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 56/112] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:12.273042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f6e7e-4245-4d4a-a0b1-99289271d0ce None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.312088 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:12.364757 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683766-8403-4bef-b60e-68d7659cecd0 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.400024 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f6e7e-4245-4d4a-a0b1-99289271d0ce None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.409501 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d1de7-f86b-4e84-b736-3669abd48d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.410169 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d1de7-f86b-4e84-b736-3669abd48d28 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.410444 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d1de7-f86b-4e84-b736-3669abd48d28 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.410716 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d1de7-f86b-4e84-b736-3669abd48d28 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.411392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d1de7-f86b-4e84-b736-3669abd48d28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:12.411700 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d1de7-f86b-4e84-b736-3669abd48d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:12.413179 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d1de7-f86b-4e84-b736-3669abd48d28 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:12.422581 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 57/113] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:38:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:12.423242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d1de7-f86b-4e84-b736-3669abd48d28 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.439560 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d7ab2-cd0b-4e76-bf2e-1206594c1100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.440204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d7ab2-cd0b-4e76-bf2e-1206594c1100 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.440481 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d7ab2-cd0b-4e76-bf2e-1206594c1100 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.440752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d7ab2-cd0b-4e76-bf2e-1206594c1100 None admin] PATH_INFO: `/v3/users/27969228664649ed9665cfa9861d3064` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.441626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:12.441883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d7ab2-cd0b-4e76-bf2e-1206594c1100 None admin] RBAC: Authorizing `identity:get_user(user_id=27969228664649ed9665cfa9861d3064)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:12.443556 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d7ab2-cd0b-4e76-bf2e-1206594c1100 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:12.445176 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 57/114] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:12 2022] GET /identity/v3/users/27969228664649ed9665cfa9861d3064 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:12.445962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d7ab2-cd0b-4e76-bf2e-1206594c1100 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.542041 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d1de7-f86b-4e84-b736-3669abd48d28 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.563861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:12.567287 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d7ab2-cd0b-4e76-bf2e-1206594c1100 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.586719 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86b2c1-05d1-48b7-9bad-ec1a15eea1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.587403 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86b2c1-05d1-48b7-9bad-ec1a15eea1b7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.587856 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86b2c1-05d1-48b7-9bad-ec1a15eea1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.588276 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86b2c1-05d1-48b7-9bad-ec1a15eea1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.589520 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86b2c1-05d1-48b7-9bad-ec1a15eea1b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:12.589717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86b2c1-05d1-48b7-9bad-ec1a15eea1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:12.599697 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86b2c1-05d1-48b7-9bad-ec1a15eea1b7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:12.603108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 58/115] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:12.604337 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86b2c1-05d1-48b7-9bad-ec1a15eea1b7 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.620218 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90a91a-c8d0-413e-b7e1-da7194e26dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.622184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a91a-c8d0-413e-b7e1-da7194e26dc8 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.622785 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a91a-c8d0-413e-b7e1-da7194e26dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.623063 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a91a-c8d0-413e-b7e1-da7194e26dc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.624557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a91a-c8d0-413e-b7e1-da7194e26dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:12.626510 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a91a-c8d0-413e-b7e1-da7194e26dc8 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:12.628116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 58/116] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:38:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:12.630526 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a73f4-3f4f-4d30-a41d-d92ee3410f61 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.630834 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a73f4-3f4f-4d30-a41d-d92ee3410f61 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.631085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a73f4-3f4f-4d30-a41d-d92ee3410f61 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.633107 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 59/117] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:12.634012 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a73f4-3f4f-4d30-a41d-d92ee3410f61 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.697364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:12.724776 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86b2c1-05d1-48b7-9bad-ec1a15eea1b7 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.750791 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a73f4-3f4f-4d30-a41d-d92ee3410f61 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.762115 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b91774-32ac-4ae5-864e-19f84649ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.762747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b91774-32ac-4ae5-864e-19f84649ac23 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.763018 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b91774-32ac-4ae5-864e-19f84649ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.763285 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b91774-32ac-4ae5-864e-19f84649ac23 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.763967 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b91774-32ac-4ae5-864e-19f84649ac23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:12.764269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b91774-32ac-4ae5-864e-19f84649ac23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:12.765672 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b91774-32ac-4ae5-864e-19f84649ac23 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:12.774775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 59/118] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:12.775627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b91774-32ac-4ae5-864e-19f84649ac23 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.796892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ab7b8-e48c-49d2-a704-53dfee570dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.797499 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ab7b8-e48c-49d2-a704-53dfee570dc5 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.797776 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ab7b8-e48c-49d2-a704-53dfee570dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.798083 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ab7b8-e48c-49d2-a704-53dfee570dc5 None admin] PATH_INFO: `/v3/users/e8676f826bd04492bdb84c50b42a20be` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.799337 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ab7b8-e48c-49d2-a704-53dfee570dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=e8676f826bd04492bdb84c50b42a20be)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:12.800808 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ab7b8-e48c-49d2-a704-53dfee570dc5 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:12.802447 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 60/119] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:12 2022] GET /identity/v3/users/e8676f826bd04492bdb84c50b42a20be => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:12.803216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ab7b8-e48c-49d2-a704-53dfee570dc5 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.846040 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:12.898167 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b91774-32ac-4ae5-864e-19f84649ac23 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.914837 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ab7b8-e48c-49d2-a704-53dfee570dc5 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:12.935423 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aec0aa-dec9-4b30-97d5-ff2e3a949412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.936488 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aec0aa-dec9-4b30-97d5-ff2e3a949412 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.936762 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aec0aa-dec9-4b30-97d5-ff2e3a949412 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.937046 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aec0aa-dec9-4b30-97d5-ff2e3a949412 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.938402 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aec0aa-dec9-4b30-97d5-ff2e3a949412 None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:12.940325 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aec0aa-dec9-4b30-97d5-ff2e3a949412 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:12.942047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 60/120] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:12 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:12.942764 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aec0aa-dec9-4b30-97d5-ff2e3a949412 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:12.948242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:12.952175 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab1c92-1e20-459f-ab8d-adb932025b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:12.952858 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1c92-1e20-459f-ab8d-adb932025b01 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.953128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1c92-1e20-459f-ab8d-adb932025b01 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.953400 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1c92-1e20-459f-ab8d-adb932025b01 None admin] PATH_INFO: `/v3/users/e8676f826bd04492bdb84c50b42a20be` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.954570 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1c92-1e20-459f-ab8d-adb932025b01 None admin] RBAC: Authorizing `identity:get_user(user_id=e8676f826bd04492bdb84c50b42a20be)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:12.956057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1c92-1e20-459f-ab8d-adb932025b01 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:12.957714 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 61/121] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:12 2022] GET /identity/v3/users/e8676f826bd04492bdb84c50b42a20be => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:12.961979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b54ac-fbf7-45f0-ba04-d068e8fcd30e None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:12.961979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b54ac-fbf7-45f0-ba04-d068e8fcd30e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:12.961979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b54ac-fbf7-45f0-ba04-d068e8fcd30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:12.977880 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-6c8b54ac-fbf7-45f0-ba04-d068e8fcd30e None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:12.979204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-6c8b54ac-fbf7-45f0-ba04-d068e8fcd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:13.070045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 62/122] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:13.070045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b54ac-fbf7-45f0-ba04-d068e8fcd30e None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:13.070315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aec0aa-dec9-4b30-97d5-ff2e3a949412 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:13.103564 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:13.108243 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da499183-22ed-4cf5-9138-46e5343cc9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:13.108880 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da499183-22ed-4cf5-9138-46e5343cc9d1 None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:13.109187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da499183-22ed-4cf5-9138-46e5343cc9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:13.109434 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da499183-22ed-4cf5-9138-46e5343cc9d1 None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:13.110130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da499183-22ed-4cf5-9138-46e5343cc9d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:13.111615 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da499183-22ed-4cf5-9138-46e5343cc9d1 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:13.144366 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 61/123] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 14:38:12 2022] POST /identity/v3/projects => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:13.145335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da499183-22ed-4cf5-9138-46e5343cc9d1 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:13.222206 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b54ac-fbf7-45f0-ba04-d068e8fcd30e None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:13.233809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:13.273034 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e0ee7-2e6e-439c-b771-2d96b487b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:13.274110 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e0ee7-2e6e-439c-b771-2d96b487b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:13.274595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e0ee7-2e6e-439c-b771-2d96b487b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:13.275570 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e0ee7-2e6e-439c-b771-2d96b487b0b0 None admin] PATH_INFO: `/v3/users/f10848a8538549d3b67d102dec2b25be` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:13.293699 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da499183-22ed-4cf5-9138-46e5343cc9d1 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:13.295128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e0ee7-2e6e-439c-b771-2d96b487b0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f10848a8538549d3b67d102dec2b25be)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:13.298183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e0ee7-2e6e-439c-b771-2d96b487b0b0 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:13.300296 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 63/124] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:13 2022] GET /identity/v3/users/f10848a8538549d3b67d102dec2b25be => generated 289 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:13.301485 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e0ee7-2e6e-439c-b771-2d96b487b0b0 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:13.347383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72718a67-f464-45eb-9fa1-dd2f1276dd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:13.348674 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72718a67-f464-45eb-9fa1-dd2f1276dd40 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:13.348962 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72718a67-f464-45eb-9fa1-dd2f1276dd40 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:13.349270 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72718a67-f464-45eb-9fa1-dd2f1276dd40 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:13.351226 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72718a67-f464-45eb-9fa1-dd2f1276dd40 None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:13.353022 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72718a67-f464-45eb-9fa1-dd2f1276dd40 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:13.354849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 62/125] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:13 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:13.355731 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72718a67-f464-45eb-9fa1-dd2f1276dd40 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:13.454773 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:13.465691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e0ee7-2e6e-439c-b771-2d96b487b0b0 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:13.502332 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72718a67-f464-45eb-9fa1-dd2f1276dd40 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:13.512156 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcce71c-a480-4218-af3f-b4d5d8436685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:13.513156 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcce71c-a480-4218-af3f-b4d5d8436685 None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:13.513636 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcce71c-a480-4218-af3f-b4d5d8436685 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:13.513984 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcce71c-a480-4218-af3f-b4d5d8436685 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/users/27969228664649ed9665cfa9861d3064/roles/d444334199c640a7af820f46e283d49d` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:13.517352 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcce71c-a480-4218-af3f-b4d5d8436685 None admin] RBAC: Authorizing `identity:create_grant(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b, user_id=27969228664649ed9665cfa9861d3064, role_id=d444334199c640a7af820f46e283d49d)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:13.520564 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcce71c-a480-4218-af3f-b4d5d8436685 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:13.536312 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 64/126] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:38:13 2022] PUT /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/users/27969228664649ed9665cfa9861d3064/roles/d444334199c640a7af820f46e283d49d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:13.539437 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:13.546978 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcce71c-a480-4218-af3f-b4d5d8436685 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:13.558779 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fecb32-7688-41e3-a853-c52ebb7efcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:13.559836 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fecb32-7688-41e3-a853-c52ebb7efcf4 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:13.560231 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fecb32-7688-41e3-a853-c52ebb7efcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:13.560600 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fecb32-7688-41e3-a853-c52ebb7efcf4 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:13.562183 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fecb32-7688-41e3-a853-c52ebb7efcf4 None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:13.564898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fecb32-7688-41e3-a853-c52ebb7efcf4 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:13.567799 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 63/127] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:13 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:13.568656 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fecb32-7688-41e3-a853-c52ebb7efcf4 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:13.679855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcce71c-a480-4218-af3f-b4d5d8436685 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:13.689513 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fecb32-7688-41e3-a853-c52ebb7efcf4 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:13.725319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3abeb3-9a1b-45dc-8078-5a28bfada936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:13.726190 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3abeb3-9a1b-45dc-8078-5a28bfada936 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:13.726568 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3abeb3-9a1b-45dc-8078-5a28bfada936 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:13.726939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3abeb3-9a1b-45dc-8078-5a28bfada936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:13.732824 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756d30a-aba0-43f7-97e5-1d8d8078c6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:13.734098 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756d30a-aba0-43f7-97e5-1d8d8078c6c8 None admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:13.734542 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756d30a-aba0-43f7-97e5-1d8d8078c6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:13.734960 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756d30a-aba0-43f7-97e5-1d8d8078c6c8 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/users/e8676f826bd04492bdb84c50b42a20be/roles/d3126a0397e243eeb3aa834efbabf407` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:13.737355 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756d30a-aba0-43f7-97e5-1d8d8078c6c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b, user_id=e8676f826bd04492bdb84c50b42a20be, role_id=d3126a0397e243eeb3aa834efbabf407)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:13.739115 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756d30a-aba0-43f7-97e5-1d8d8078c6c8 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:13.759044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 64/128] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:38:13 2022] PUT /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/users/e8676f826bd04492bdb84c50b42a20be/roles/d3126a0397e243eeb3aa834efbabf407 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:13.759812 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:13.762131 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756d30a-aba0-43f7-97e5-1d8d8078c6c8 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:13.841466 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3abeb3-9a1b-45dc-8078-5a28bfada936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:13.843266 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3abeb3-9a1b-45dc-8078-5a28bfada936 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:13.858918 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:13.993547 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756d30a-aba0-43f7-97e5-1d8d8078c6c8 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:14.061072 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa9d3e-083d-44f5-9f49-77aa0a1f4000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:14.061759 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa9d3e-083d-44f5-9f49-77aa0a1f4000 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:14.062296 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa9d3e-083d-44f5-9f49-77aa0a1f4000 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:14.062585 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa9d3e-083d-44f5-9f49-77aa0a1f4000 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:14.079712 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa9d3e-083d-44f5-9f49-77aa0a1f4000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-48aa9d3e-083d-44f5-9f49-77aa0a1f4000 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:14.089644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:14.090614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:14.091364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:14.092473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 65/130] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:14.092554 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 65/130] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:14.092852 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3abeb3-9a1b-45dc-8078-5a28bfada936 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:14.100962 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa9d3e-083d-44f5-9f49-77aa0a1f4000 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:14.239530 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:14.354028 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa9d3e-083d-44f5-9f49-77aa0a1f4000 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:14.380208 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3abeb3-9a1b-45dc-8078-5a28bfada936 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:14.394620 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:14.426544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa7183-7626-4f28-96bf-1b9189220371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:14.426544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa7183-7626-4f28-96bf-1b9189220371 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:14.426544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa7183-7626-4f28-96bf-1b9189220371 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:14.426544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa7183-7626-4f28-96bf-1b9189220371 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:14.426955 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa7183-7626-4f28-96bf-1b9189220371 None admin] RBAC: Adding query filter params (name=member) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:14.426955 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa7183-7626-4f28-96bf-1b9189220371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:14.429344 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa7183-7626-4f28-96bf-1b9189220371 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:14.451988 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 66/131] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:14.452648 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa7183-7626-4f28-96bf-1b9189220371 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:14.473978 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841348f-50dd-4c8c-a637-5ba5651e249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:14.474930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841348f-50dd-4c8c-a637-5ba5651e249b None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:14.475352 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841348f-50dd-4c8c-a637-5ba5651e249b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:14.475775 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841348f-50dd-4c8c-a637-5ba5651e249b None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/users/e8676f826bd04492bdb84c50b42a20be/roles/d4bd126c45e24b93a90052154a32972b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:14.478069 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841348f-50dd-4c8c-a637-5ba5651e249b None admin] RBAC: Authorizing `identity:create_grant(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b, user_id=e8676f826bd04492bdb84c50b42a20be, role_id=d4bd126c45e24b93a90052154a32972b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:14.479965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841348f-50dd-4c8c-a637-5ba5651e249b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:14.518417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 66/132] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:38:14 2022] PUT /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/users/e8676f826bd04492bdb84c50b42a20be/roles/d4bd126c45e24b93a90052154a32972b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:14.519951 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841348f-50dd-4c8c-a637-5ba5651e249b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:14.822727 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa7183-7626-4f28-96bf-1b9189220371 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:14.953618 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841348f-50dd-4c8c-a637-5ba5651e249b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:14.975192 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:14.995716 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f1b5c-6a2a-4de9-89ae-06c5038abe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:14.996529 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f1b5c-6a2a-4de9-89ae-06c5038abe3b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:14.996922 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f1b5c-6a2a-4de9-89ae-06c5038abe3b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:14.997283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f1b5c-6a2a-4de9-89ae-06c5038abe3b None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:14.999612 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f1b5c-6a2a-4de9-89ae-06c5038abe3b None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:15.001370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f1b5c-6a2a-4de9-89ae-06c5038abe3b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:15.004494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 67/133] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:14 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 552 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:15.014456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f1b5c-6a2a-4de9-89ae-06c5038abe3b None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:15.033511 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e1c7b-a3cd-42f8-97a4-b72d84f7acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:15.034250 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e1c7b-a3cd-42f8-97a4-b72d84f7acf7 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:15.034531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e1c7b-a3cd-42f8-97a4-b72d84f7acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:15.034798 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e1c7b-a3cd-42f8-97a4-b72d84f7acf7 None admin] PATH_INFO: `/v3/users/e8676f826bd04492bdb84c50b42a20be` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:15.038997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e1c7b-a3cd-42f8-97a4-b72d84f7acf7 None admin] RBAC: Authorizing `identity:get_user(user_id=e8676f826bd04492bdb84c50b42a20be)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:15.040816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e1c7b-a3cd-42f8-97a4-b72d84f7acf7 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:15.044109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 67/134] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:14 2022] GET /identity/v3/users/e8676f826bd04492bdb84c50b42a20be => generated 275 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:15.052347 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e1c7b-a3cd-42f8-97a4-b72d84f7acf7 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:15.113235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:15.202811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f1b5c-6a2a-4de9-89ae-06c5038abe3b None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:15.271787 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9275ecb-1f24-4237-93b0-39c253eed908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:15.272777 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275ecb-1f24-4237-93b0-39c253eed908 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:15.273286 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275ecb-1f24-4237-93b0-39c253eed908 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:15.273747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275ecb-1f24-4237-93b0-39c253eed908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:15.274725 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275ecb-1f24-4237-93b0-39c253eed908 None admin] RBAC: Adding query filter params (role.id=6a16969a32c74a0cb50a64ae9973c938, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b, user.id=f10848a8538549d3b67d102dec2b25be) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:15.275240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275ecb-1f24-4237-93b0-39c253eed908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:15.278375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275ecb-1f24-4237-93b0-39c253eed908 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:15.295169 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 68/135] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:15 2022] GET /identity/v3/role_assignments?user.id=f10848a8538549d3b67d102dec2b25be&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=6a16969a32c74a0cb50a64ae9973c938 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:15.316711 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e1c7b-a3cd-42f8-97a4-b72d84f7acf7 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:15.383171 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d8ec-36f9-4cf7-acc6-046b3b2e2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:15.384201 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d8ec-36f9-4cf7-acc6-046b3b2e2da1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:15.384673 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d8ec-36f9-4cf7-acc6-046b3b2e2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:15.385143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d8ec-36f9-4cf7-acc6-046b3b2e2da1 None admin] PATH_INFO: `/v3/projects/c67c7c49a672495e81a9cd13125938de` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:15.390728 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476d8ec-36f9-4cf7-acc6-046b3b2e2da1 None admin] RBAC: Authorizing `identity:get_project(project_id=c67c7c49a672495e81a9cd13125938de)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:15.392214 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476d8ec-36f9-4cf7-acc6-046b3b2e2da1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:15.394326 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 68/136] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:15 2022] GET /identity/v3/projects/c67c7c49a672495e81a9cd13125938de => generated 312 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:15.403331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9275ecb-1f24-4237-93b0-39c253eed908 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:15.622983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9275ecb-1f24-4237-93b0-39c253eed908 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:15.638386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:15.702066 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c12464-9269-4b8c-a2f1-b71089ccbc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:15.703244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c12464-9269-4b8c-a2f1-b71089ccbc34 None admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:15.703735 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c12464-9269-4b8c-a2f1-b71089ccbc34 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:15.704208 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c12464-9269-4b8c-a2f1-b71089ccbc34 None admin] PATH_INFO: `/v3/projects/c67c7c49a672495e81a9cd13125938de/users/e8676f826bd04492bdb84c50b42a20be/roles/d4bd126c45e24b93a90052154a32972b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:15.707696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c12464-9269-4b8c-a2f1-b71089ccbc34 None admin] RBAC: Authorizing `identity:create_grant(project_id=c67c7c49a672495e81a9cd13125938de, user_id=e8676f826bd04492bdb84c50b42a20be, role_id=d4bd126c45e24b93a90052154a32972b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:15.715430 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c12464-9269-4b8c-a2f1-b71089ccbc34 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:15.739283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 69/137] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:38:15 2022] PUT /identity/v3/projects/c67c7c49a672495e81a9cd13125938de/users/e8676f826bd04492bdb84c50b42a20be/roles/d4bd126c45e24b93a90052154a32972b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 14:38:17.041587 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb461d5-7957-41d0-8778-a9106eab61b6 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:17.042262 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb461d5-7957-41d0-8778-a9106eab61b6 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:17.042262 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb461d5-7957-41d0-8778-a9106eab61b6 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:17.043679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 69/138] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:17.060093 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fefd21-2bd5-4056-a6f4-0ab17d261f3e None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:17.060626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fefd21-2bd5-4056-a6f4-0ab17d261f3e None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:17.060626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fefd21-2bd5-4056-a6f4-0ab17d261f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:17.091189 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-51fefd21-2bd5-4056-a6f4-0ab17d261f3e None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:17.092536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-51fefd21-2bd5-4056-a6f4-0ab17d261f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:17.200760 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 70/139] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:38:17.434324 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420db0-268d-47e4-993f-84c1682bff75 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:17.434599 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420db0-268d-47e4-993f-84c1682bff75 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:17.435108 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420db0-268d-47e4-993f-84c1682bff75 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:17.436652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 70/140] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:17.442758 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bb584-f9c0-4285-ab36-b969c36ee92e None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:17.443354 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bb584-f9c0-4285-ab36-b969c36ee92e None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:17.443848 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bb584-f9c0-4285-ab36-b969c36ee92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:17.468137 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-ab2bb584-f9c0-4285-ab36-b969c36ee92e None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:17.470860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-ab2bb584-f9c0-4285-ab36-b969c36ee92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:17.577763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 71/141] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:17.665829 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776856aa-73bd-4e0b-b24b-a8e99512b4eb None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:17.666224 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776856aa-73bd-4e0b-b24b-a8e99512b4eb None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:17.666692 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776856aa-73bd-4e0b-b24b-a8e99512b4eb None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:17.668927 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 71/142] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:17.675382 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664af33-9567-4288-8159-3ae859db258c None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:17.675833 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664af33-9567-4288-8159-3ae859db258c None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:17.676115 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664af33-9567-4288-8159-3ae859db258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:17.709135 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-f664af33-9567-4288-8159-3ae859db258c None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:17.710568 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-f664af33-9567-4288-8159-3ae859db258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:17.740080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:17.786702 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776856aa-73bd-4e0b-b24b-a8e99512b4eb None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:17.833222 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 72/143] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:17.877183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:17.950848 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776856aa-73bd-4e0b-b24b-a8e99512b4eb None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:18.002099 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2bd50-758e-4242-a22c-2e16263b9546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:18.003113 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2bd50-758e-4242-a22c-2e16263b9546 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:18.003584 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2bd50-758e-4242-a22c-2e16263b9546 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:18.004071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2bd50-758e-4242-a22c-2e16263b9546 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:18.006521 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2bd50-758e-4242-a22c-2e16263b9546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:18.008178 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2bd50-758e-4242-a22c-2e16263b9546 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:18.010334 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 72/144] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:38:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:18.016824 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664af33-9567-4288-8159-3ae859db258c None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:18.147452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2bd50-758e-4242-a22c-2e16263b9546 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:18.149811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664af33-9567-4288-8159-3ae859db258c None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:18.197555 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3f238-e7d6-495b-8a7a-02a7991f7903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:18.198429 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3f238-e7d6-495b-8a7a-02a7991f7903 None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:18.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3f238-e7d6-495b-8a7a-02a7991f7903 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:18.198932 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3f238-e7d6-495b-8a7a-02a7991f7903 None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:18.199593 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3f238-e7d6-495b-8a7a-02a7991f7903 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:18.201263 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3f238-e7d6-495b-8a7a-02a7991f7903 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:18.237963 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 73/145] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:38:18 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:18.349752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2bd50-758e-4242-a22c-2e16263b9546 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:18.374854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:18.387256 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13085bb6-d7b8-4c2b-8f4c-027ac3fce6d8 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:18.387756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13085bb6-d7b8-4c2b-8f4c-027ac3fce6d8 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:18.388168 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13085bb6-d7b8-4c2b-8f4c-027ac3fce6d8 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:18.389805 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 74/146] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:38:18.398728 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253807-ad60-4540-b918-fb98045abd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:18.399387 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253807-ad60-4540-b918-fb98045abd5a None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:18.399846 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253807-ad60-4540-b918-fb98045abd5a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:18.400125 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253807-ad60-4540-b918-fb98045abd5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:18.400405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6e5b8-56fa-4051-ad71-bb8d65af5f82 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:18.400837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6e5b8-56fa-4051-ad71-bb8d65af5f82 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:18.401347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6e5b8-56fa-4051-ad71-bb8d65af5f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:18.414381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253807-ad60-4540-b918-fb98045abd5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-bc253807-ad60-4540-b918-fb98045abd5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:18.419768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:18.420883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:18.421748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 73/147] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:38:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:38:18.433975 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253807-ad60-4540-b918-fb98045abd5a None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:18.447168 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-8aa6e5b8-56fa-4051-ad71-bb8d65af5f82 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:18.449049 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-8aa6e5b8-56fa-4051-ad71-bb8d65af5f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:18.466521 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:18.605410 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 75/148] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:38:18.606754 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6e5b8-56fa-4051-ad71-bb8d65af5f82 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:18.658391 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253807-ad60-4540-b918-fb98045abd5a None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:18.760156 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb1afd-0a14-4ed1-a54a-e94094d94c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:18.761676 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb1afd-0a14-4ed1-a54a-e94094d94c1c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:18.762235 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb1afd-0a14-4ed1-a54a-e94094d94c1c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:18.762721 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb1afd-0a14-4ed1-a54a-e94094d94c1c None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:18.763607 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb1afd-0a14-4ed1-a54a-e94094d94c1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:18.764131 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb1afd-0a14-4ed1-a54a-e94094d94c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:18.765752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb1afd-0a14-4ed1-a54a-e94094d94c1c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:18.776726 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 74/149] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:38:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:18.783668 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb1afd-0a14-4ed1-a54a-e94094d94c1c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:18.834317 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:18.913618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6e5b8-56fa-4051-ad71-bb8d65af5f82 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:18.926404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb1afd-0a14-4ed1-a54a-e94094d94c1c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:18.960869 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fce39d-12e8-4415-9f91-9a4b4b0dc01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:18.962496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fce39d-12e8-4415-9f91-9a4b4b0dc01d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:18.963218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fce39d-12e8-4415-9f91-9a4b4b0dc01d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:18.964814 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fce39d-12e8-4415-9f91-9a4b4b0dc01d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:18.969206 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88463c-2de4-45ce-a76b-5cda6c0eb82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:18.969804 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88463c-2de4-45ce-a76b-5cda6c0eb82f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:18.970112 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88463c-2de4-45ce-a76b-5cda6c0eb82f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:18.970383 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88463c-2de4-45ce-a76b-5cda6c0eb82f None admin] PATH_INFO: `/v3/users/e8676f826bd04492bdb84c50b42a20be` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:18.971561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88463c-2de4-45ce-a76b-5cda6c0eb82f None admin] RBAC: Authorizing `identity:get_user(user_id=e8676f826bd04492bdb84c50b42a20be)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:18.973015 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88463c-2de4-45ce-a76b-5cda6c0eb82f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:18.974845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 75/150] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:18 2022] GET /identity/v3/users/e8676f826bd04492bdb84c50b42a20be => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:18.976015 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbef909-1acd-4302-85ab-b49ec3ac98bf None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:18.976291 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbef909-1acd-4302-85ab-b49ec3ac98bf None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:18.976560 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbef909-1acd-4302-85ab-b49ec3ac98bf None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:18.982385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 76/151] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:18.983646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbef909-1acd-4302-85ab-b49ec3ac98bf None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:18.987790 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fce39d-12e8-4415-9f91-9a4b4b0dc01d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-04fce39d-12e8-4415-9f91-9a4b4b0dc01d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:18.995909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:18.996903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:18.997750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:19.000120 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 76/152] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:38:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:19.001684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dcd70-77b8-4ddd-9d95-a6a3925338e0 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:19.002304 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dcd70-77b8-4ddd-9d95-a6a3925338e0 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:19.002872 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dcd70-77b8-4ddd-9d95-a6a3925338e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:19.011851 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:19.032320 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-ba9dcd70-77b8-4ddd-9d95-a6a3925338e0 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:19.033525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-ba9dcd70-77b8-4ddd-9d95-a6a3925338e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:19.143269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 77/153] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:19.144671 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dcd70-77b8-4ddd-9d95-a6a3925338e0 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:19.181017 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbef909-1acd-4302-85ab-b49ec3ac98bf None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:19.195351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:19.262211 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1d15-a43d-4985-ac3c-42ef2b22b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:19.263381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1d15-a43d-4985-ac3c-42ef2b22b060 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:19.263921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1d15-a43d-4985-ac3c-42ef2b22b060 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:19.264560 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1d15-a43d-4985-ac3c-42ef2b22b060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:19.281532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dcd70-77b8-4ddd-9d95-a6a3925338e0 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:19.318296 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:19.328254 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42dc3-4859-4c87-b3aa-a053ffd3d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:19.328254 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42dc3-4859-4c87-b3aa-a053ffd3d781 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:19.328254 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42dc3-4859-4c87-b3aa-a053ffd3d781 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:19.328254 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42dc3-4859-4c87-b3aa-a053ffd3d781 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:19.328654 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42dc3-4859-4c87-b3aa-a053ffd3d781 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:19.328654 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42dc3-4859-4c87-b3aa-a053ffd3d781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:19.328654 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42dc3-4859-4c87-b3aa-a053ffd3d781 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:19.340235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 78/154] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:19.341110 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42dc3-4859-4c87-b3aa-a053ffd3d781 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:19.416397 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1d15-a43d-4985-ac3c-42ef2b22b060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:19.427064 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1d15-a43d-4985-ac3c-42ef2b22b060 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:19.479913 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42dc3-4859-4c87-b3aa-a053ffd3d781 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:19.530176 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b984-4628-433a-b10a-2b6f0029a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:19.530749 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b984-4628-433a-b10a-2b6f0029a83c None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:19.531018 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b984-4628-433a-b10a-2b6f0029a83c None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:19.531284 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b984-4628-433a-b10a-2b6f0029a83c None admin] PATH_INFO: `/v3/roles/member` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:19.546940 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381b984-4628-433a-b10a-2b6f0029a83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-7381b984-4628-433a-b10a-2b6f0029a83c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:19.554786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:19.555680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:19.557010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 79/155] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:19.558222 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b984-4628-433a-b10a-2b6f0029a83c None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:19.558334 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 77/156] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:19.562275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251ba5-52cb-46b2-8679-46eca68f057e None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:19.562275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251ba5-52cb-46b2-8679-46eca68f057e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:19.562275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251ba5-52cb-46b2-8679-46eca68f057e None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:19.562275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 78/157] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:19.573063 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66251ba5-52cb-46b2-8679-46eca68f057e None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:19.589877 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:19.672334 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:19.737883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66251ba5-52cb-46b2-8679-46eca68f057e None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:19.744978 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b984-4628-433a-b10a-2b6f0029a83c None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:19.778949 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95300762-4281-41f7-8abb-2cc6f933e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:19.779595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300762-4281-41f7-8abb-2cc6f933e52a None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:19.779871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300762-4281-41f7-8abb-2cc6f933e52a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:19.780279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300762-4281-41f7-8abb-2cc6f933e52a None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:19.781434 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95300762-4281-41f7-8abb-2cc6f933e52a None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:19.783133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95300762-4281-41f7-8abb-2cc6f933e52a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:19.785424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 79/158] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:19 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:19.787370 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9de4a-858e-411b-af3c-b6f8fb98bfac None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:19.787887 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9de4a-858e-411b-af3c-b6f8fb98bfac None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:19.788101 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9de4a-858e-411b-af3c-b6f8fb98bfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:19.813051 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa215647-b179-4b94-b9d9-bacf2b2032e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:19.814511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa215647-b179-4b94-b9d9-bacf2b2032e3 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:19.815000 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa215647-b179-4b94-b9d9-bacf2b2032e3 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:19.815361 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-27f9de4a-858e-411b-af3c-b6f8fb98bfac None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:19.815715 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa215647-b179-4b94-b9d9-bacf2b2032e3 None admin] PATH_INFO: `/v3/users/27969228664649ed9665cfa9861d3064` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:19.817061 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-27f9de4a-858e-411b-af3c-b6f8fb98bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:19.817364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa215647-b179-4b94-b9d9-bacf2b2032e3 None admin] RBAC: Authorizing `identity:get_user(user_id=27969228664649ed9665cfa9861d3064)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:19.819136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa215647-b179-4b94-b9d9-bacf2b2032e3 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:19.822278 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 80/159] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:19 2022] GET /identity/v3/users/27969228664649ed9665cfa9861d3064 => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:19.823419 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa215647-b179-4b94-b9d9-bacf2b2032e3 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:19.952131 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 80/160] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:19.953029 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9de4a-858e-411b-af3c-b6f8fb98bfac None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:19.964920 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:20.104367 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa215647-b179-4b94-b9d9-bacf2b2032e3 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:20.143155 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:20.166439 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59670a-4b5b-49e2-a1aa-e346cb84db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:20.167530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59670a-4b5b-49e2-a1aa-e346cb84db4f None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:20.168321 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59670a-4b5b-49e2-a1aa-e346cb84db4f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:20.168840 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59670a-4b5b-49e2-a1aa-e346cb84db4f None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:20.169788 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59670a-4b5b-49e2-a1aa-e346cb84db4f None admin] RBAC: Adding query filter params (name=member) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:20.170533 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59670a-4b5b-49e2-a1aa-e346cb84db4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:20.172729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59670a-4b5b-49e2-a1aa-e346cb84db4f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:20.181869 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9de4a-858e-411b-af3c-b6f8fb98bfac None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:20.184563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 81/161] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:20.191719 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59670a-4b5b-49e2-a1aa-e346cb84db4f None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:20.284313 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da419-03ae-4409-b632-166e86310e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:20.286109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da419-03ae-4409-b632-166e86310e1c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:20.286427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da419-03ae-4409-b632-166e86310e1c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:20.288910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da419-03ae-4409-b632-166e86310e1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:20.322709 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346da419-03ae-4409-b632-166e86310e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-346da419-03ae-4409-b632-166e86310e1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:20.328188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:20.329160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:20.329955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 81/162] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:20.330601 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da419-03ae-4409-b632-166e86310e1c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:20.443857 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59670a-4b5b-49e2-a1aa-e346cb84db4f None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:20.487128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:20.491506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038d334-8ee6-4a1b-8dd8-62f2c4ea0186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:20.492222 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038d334-8ee6-4a1b-8dd8-62f2c4ea0186 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:20.492642 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038d334-8ee6-4a1b-8dd8-62f2c4ea0186 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:20.492943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038d334-8ee6-4a1b-8dd8-62f2c4ea0186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:20.493784 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038d334-8ee6-4a1b-8dd8-62f2c4ea0186 None admin] RBAC: Adding query filter params (role.id=d3126a0397e243eeb3aa834efbabf407, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b, user.id=e8676f826bd04492bdb84c50b42a20be) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:20.494120 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038d334-8ee6-4a1b-8dd8-62f2c4ea0186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:20.500608 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038d334-8ee6-4a1b-8dd8-62f2c4ea0186 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:20.524570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 82/163] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:20 2022] GET /identity/v3/role_assignments?user.id=e8676f826bd04492bdb84c50b42a20be&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=d3126a0397e243eeb3aa834efbabf407 => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:20.525961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038d334-8ee6-4a1b-8dd8-62f2c4ea0186 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:20.618372 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:20.631961 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da419-03ae-4409-b632-166e86310e1c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:20.719924 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038d334-8ee6-4a1b-8dd8-62f2c4ea0186 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:20.746359 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717b08-8a41-4233-ac60-90f2a71519ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:20.747364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717b08-8a41-4233-ac60-90f2a71519ba None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:20.747834 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717b08-8a41-4233-ac60-90f2a71519ba None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:20.748321 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717b08-8a41-4233-ac60-90f2a71519ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:20.808066 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc3a0-ada8-4f78-ae59-7d7b19f968df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:20.808546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc3a0-ada8-4f78-ae59-7d7b19f968df None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:20.808816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc3a0-ada8-4f78-ae59-7d7b19f968df None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:20.809092 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc3a0-ada8-4f78-ae59-7d7b19f968df None admin] PATH_INFO: `/v3/users/e8676f826bd04492bdb84c50b42a20be` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:20.811369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bc3a0-ada8-4f78-ae59-7d7b19f968df None admin] RBAC: Authorizing `identity:get_user(user_id=e8676f826bd04492bdb84c50b42a20be)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:20.812906 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bc3a0-ada8-4f78-ae59-7d7b19f968df None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:20.814912 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 83/164] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:20 2022] GET /identity/v3/users/e8676f826bd04492bdb84c50b42a20be => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:20.815695 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc3a0-ada8-4f78-ae59-7d7b19f968df None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:20.870159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56717b08-8a41-4233-ac60-90f2a71519ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:20.871770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56717b08-8a41-4233-ac60-90f2a71519ba None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:21.035971 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:21.047808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc3a0-ada8-4f78-ae59-7d7b19f968df None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:21.079184 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:21.105107 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 82/165] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:21.109307 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717b08-8a41-4233-ac60-90f2a71519ba None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:21.124311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111d19b-059b-4ac1-bce8-fc426926d6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:21.125272 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d19b-059b-4ac1-bce8-fc426926d6a1 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:21.125720 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d19b-059b-4ac1-bce8-fc426926d6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:21.126197 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d19b-059b-4ac1-bce8-fc426926d6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:21.127311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111d19b-059b-4ac1-bce8-fc426926d6a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:21.127803 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111d19b-059b-4ac1-bce8-fc426926d6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:21.129965 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111d19b-059b-4ac1-bce8-fc426926d6a1 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:21.162365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 84/166] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:21.166703 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111d19b-059b-4ac1-bce8-fc426926d6a1 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:21.295544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717b08-8a41-4233-ac60-90f2a71519ba None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:21.335026 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7ca4-20d5-4acb-834c-b95235700df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:21.335853 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7ca4-20d5-4acb-834c-b95235700df2 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:21.336212 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7ca4-20d5-4acb-834c-b95235700df2 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:21.336595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7ca4-20d5-4acb-834c-b95235700df2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:21.348785 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda7ca4-20d5-4acb-834c-b95235700df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-1dda7ca4-20d5-4acb-834c-b95235700df2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:21.353982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:21.355753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 83/167] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:21.358085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7ca4-20d5-4acb-834c-b95235700df2 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:21.391441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:21.459419 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111d19b-059b-4ac1-bce8-fc426926d6a1 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:21.468428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7ca4-20d5-4acb-834c-b95235700df2 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:21.522525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae6308-99bc-418a-90ee-6d41d81bce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:21.523318 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae6308-99bc-418a-90ee-6d41d81bce5e None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:21.523716 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae6308-99bc-418a-90ee-6d41d81bce5e None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:21.524086 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae6308-99bc-418a-90ee-6d41d81bce5e None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:21.525317 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae6308-99bc-418a-90ee-6d41d81bce5e None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:21.527367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae6308-99bc-418a-90ee-6d41d81bce5e None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:21.529757 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 84/168] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:21 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:21.530712 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae6308-99bc-418a-90ee-6d41d81bce5e None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:21.585664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d45b9-f54c-4d9e-931b-70809f6cca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:21.586598 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d45b9-f54c-4d9e-931b-70809f6cca47 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:21.587064 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d45b9-f54c-4d9e-931b-70809f6cca47 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:21.587531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d45b9-f54c-4d9e-931b-70809f6cca47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:21.647243 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:21.656752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae6308-99bc-418a-90ee-6d41d81bce5e None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:21.697644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979b30a-1094-4b47-aa9c-04b9ba1516bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:21.698559 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979b30a-1094-4b47-aa9c-04b9ba1516bd None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:21.699056 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979b30a-1094-4b47-aa9c-04b9ba1516bd None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:21.699434 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979b30a-1094-4b47-aa9c-04b9ba1516bd None admin] PATH_INFO: `/v3/users/f10848a8538549d3b67d102dec2b25be` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:21.700845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979b30a-1094-4b47-aa9c-04b9ba1516bd None admin] RBAC: Authorizing `identity:get_user(user_id=f10848a8538549d3b67d102dec2b25be)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:21.702559 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979b30a-1094-4b47-aa9c-04b9ba1516bd None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:21.704349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 85/169] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:21 2022] GET /identity/v3/users/f10848a8538549d3b67d102dec2b25be => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:21.705236 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979b30a-1094-4b47-aa9c-04b9ba1516bd None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:21.725148 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:21.780608 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d45b9-f54c-4d9e-931b-70809f6cca47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:21.780608 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d45b9-f54c-4d9e-931b-70809f6cca47 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:21.867306 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979b30a-1094-4b47-aa9c-04b9ba1516bd None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:21.933041 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002b3ba-60d9-4e4e-ada2-52991b9bff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:21.934253 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002b3ba-60d9-4e4e-ada2-52991b9bff51 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:21.934758 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002b3ba-60d9-4e4e-ada2-52991b9bff51 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:21.935442 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002b3ba-60d9-4e4e-ada2-52991b9bff51 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:21.936323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002b3ba-60d9-4e4e-ada2-52991b9bff51 None admin] RBAC: Adding query filter params (name=member) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:21.936913 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002b3ba-60d9-4e4e-ada2-52991b9bff51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:21.938626 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002b3ba-60d9-4e4e-ada2-52991b9bff51 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:21.949866 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 86/170] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:21.951117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002b3ba-60d9-4e4e-ada2-52991b9bff51 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:22.009937 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:22.074046 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 85/171] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 910 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:22.074945 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d45b9-f54c-4d9e-931b-70809f6cca47 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:22.130802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002b3ba-60d9-4e4e-ada2-52991b9bff51 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:22.178320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee01750-2189-4040-b569-4e0a3c8c224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:22.179629 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01750-2189-4040-b569-4e0a3c8c224f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:22.180700 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01750-2189-4040-b569-4e0a3c8c224f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:22.180991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01750-2189-4040-b569-4e0a3c8c224f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:22.182591 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee01750-2189-4040-b569-4e0a3c8c224f None admin] RBAC: Adding query filter params (role.id=d444334199c640a7af820f46e283d49d, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b, user.id=27969228664649ed9665cfa9861d3064) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:22.183381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee01750-2189-4040-b569-4e0a3c8c224f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:22.186588 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee01750-2189-4040-b569-4e0a3c8c224f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:22.195537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 87/172] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:21 2022] GET /identity/v3/role_assignments?user.id=27969228664649ed9665cfa9861d3064&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=d444334199c640a7af820f46e283d49d => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:22.197219 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee01750-2189-4040-b569-4e0a3c8c224f None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:22.197729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:22.225334 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d45b9-f54c-4d9e-931b-70809f6cca47 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:22.271744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bc83e-1ede-4afc-b665-f029498de1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:22.272436 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bc83e-1ede-4afc-b665-f029498de1f5 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:22.272766 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bc83e-1ede-4afc-b665-f029498de1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:22.273050 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bc83e-1ede-4afc-b665-f029498de1f5 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:22.274554 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bc83e-1ede-4afc-b665-f029498de1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:22.276471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bc83e-1ede-4afc-b665-f029498de1f5 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:22.278678 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 86/173] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:22 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:22.285941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0da9-6e65-4f68-a034-a4d96a8bd71c None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:22.285941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0da9-6e65-4f68-a034-a4d96a8bd71c None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:22.285941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0da9-6e65-4f68-a034-a4d96a8bd71c None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:22.285941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 87/174] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:22.285941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0da9-6e65-4f68-a034-a4d96a8bd71c None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:22.334975 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:22.358230 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee01750-2189-4040-b569-4e0a3c8c224f None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:22.418554 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978be3d4-85ad-4497-bc11-727148431193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:22.421294 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be3d4-85ad-4497-bc11-727148431193 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:22.421943 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be3d4-85ad-4497-bc11-727148431193 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:22.422392 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be3d4-85ad-4497-bc11-727148431193 None admin] PATH_INFO: `/v3/users/e8676f826bd04492bdb84c50b42a20be` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:22.424790 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978be3d4-85ad-4497-bc11-727148431193 None admin] RBAC: Authorizing `identity:get_user(user_id=e8676f826bd04492bdb84c50b42a20be)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:22.434929 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978be3d4-85ad-4497-bc11-727148431193 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:22.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 88/175] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:22 2022] GET /identity/v3/users/e8676f826bd04492bdb84c50b42a20be => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:22.438447 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978be3d4-85ad-4497-bc11-727148431193 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:22.537533 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0da9-6e65-4f68-a034-a4d96a8bd71c None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:22.591983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60626c82-d2a5-4fd3-9ada-39c7af53721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:22.592190 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60626c82-d2a5-4fd3-9ada-39c7af53721e None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:22.592378 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60626c82-d2a5-4fd3-9ada-39c7af53721e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:22.592819 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60626c82-d2a5-4fd3-9ada-39c7af53721e None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:22.594604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60626c82-d2a5-4fd3-9ada-39c7af53721e None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:22.598671 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60626c82-d2a5-4fd3-9ada-39c7af53721e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:22.601705 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 88/176] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:22 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:22.603162 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad964a-7658-4ee2-99a9-05264c95403d None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:22.603510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad964a-7658-4ee2-99a9-05264c95403d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:22.612151 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad964a-7658-4ee2-99a9-05264c95403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:22.646397 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-aaad964a-7658-4ee2-99a9-05264c95403d None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:22.648773 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-aaad964a-7658-4ee2-99a9-05264c95403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:22.655807 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978be3d4-85ad-4497-bc11-727148431193 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:22.675736 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:22.716212 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1a6bc-e4e3-4fce-8958-a33cb3ca50a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:22.717224 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1a6bc-e4e3-4fce-8958-a33cb3ca50a7 None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:22.717499 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1a6bc-e4e3-4fce-8958-a33cb3ca50a7 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:22.717765 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1a6bc-e4e3-4fce-8958-a33cb3ca50a7 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/users/f10848a8538549d3b67d102dec2b25be/roles/6a16969a32c74a0cb50a64ae9973c938` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:22.723537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1a6bc-e4e3-4fce-8958-a33cb3ca50a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b, user_id=f10848a8538549d3b67d102dec2b25be, role_id=6a16969a32c74a0cb50a64ae9973c938)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:22.723537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1a6bc-e4e3-4fce-8958-a33cb3ca50a7 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:22.748137 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 89/177] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:38:22 2022] PUT /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/users/f10848a8538549d3b67d102dec2b25be/roles/6a16969a32c74a0cb50a64ae9973c938 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:22.755861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1a6bc-e4e3-4fce-8958-a33cb3ca50a7 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:22.773089 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 89/178] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:22.774878 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad964a-7658-4ee2-99a9-05264c95403d None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:22.784692 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:22.928784 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad964a-7658-4ee2-99a9-05264c95403d None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:22.959137 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1a6bc-e4e3-4fce-8958-a33cb3ca50a7 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:23.002902 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1caa5a-fccc-47ed-a02e-53edf6cd1896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:23.004090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4d527-dd29-4735-85c5-4035577a6db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:23.004800 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4d527-dd29-4735-85c5-4035577a6db0 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.005143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4d527-dd29-4735-85c5-4035577a6db0 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.005400 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1caa5a-fccc-47ed-a02e-53edf6cd1896 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.005583 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4d527-dd29-4735-85c5-4035577a6db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.006557 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1caa5a-fccc-47ed-a02e-53edf6cd1896 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.007285 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1caa5a-fccc-47ed-a02e-53edf6cd1896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.008407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1caa5a-fccc-47ed-a02e-53edf6cd1896 None admin] RBAC: Adding query filter params (role.id=d4bd126c45e24b93a90052154a32972b, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b, user.id=e8676f826bd04492bdb84c50b42a20be) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:23.008901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1caa5a-fccc-47ed-a02e-53edf6cd1896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:23.010782 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1caa5a-fccc-47ed-a02e-53edf6cd1896 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:23.018396 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 90/179] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:22 2022] GET /identity/v3/role_assignments?user.id=e8676f826bd04492bdb84c50b42a20be&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=d4bd126c45e24b93a90052154a32972b => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:23.020101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d08e-d51a-480c-9aef-1f19ebe2eaef None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.020558 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d08e-d51a-480c-9aef-1f19ebe2eaef None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.020985 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d08e-d51a-480c-9aef-1f19ebe2eaef None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.022887 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 91/180] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:23.030022 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834e3b-6fc5-4829-a847-848cf11d7ffa None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.031245 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834e3b-6fc5-4829-a847-848cf11d7ffa None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.031945 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834e3b-6fc5-4829-a847-848cf11d7ffa None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.034870 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 92/181] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:23 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:23.038142 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5f1b6-b5e1-4449-8eb5-9a418f7ef8aa None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.038679 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5f1b6-b5e1-4449-8eb5-9a418f7ef8aa None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.039410 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5f1b6-b5e1-4449-8eb5-9a418f7ef8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.064751 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-daa5f1b6-b5e1-4449-8eb5-9a418f7ef8aa None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:23.067344 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-daa5f1b6-b5e1-4449-8eb5-9a418f7ef8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:23.074967 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:23.127047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4d527-dd29-4735-85c5-4035577a6db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:23.128715 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4d527-dd29-4735-85c5-4035577a6db0 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:23.160392 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:23.218392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 93/182] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:23.219674 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be224-b3eb-4204-ac00-b9cd68de6422 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.219959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be224-b3eb-4204-ac00-b9cd68de6422 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.220221 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be224-b3eb-4204-ac00-b9cd68de6422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.240533 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-848be224-b3eb-4204-ac00-b9cd68de6422 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:23.241796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-848be224-b3eb-4204-ac00-b9cd68de6422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:23.323465 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 90/183] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:23.324911 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4d527-dd29-4735-85c5-4035577a6db0 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:23.394213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 94/184] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:23.394213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be224-b3eb-4204-ac00-b9cd68de6422 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:23.463010 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4d527-dd29-4735-85c5-4035577a6db0 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:23.474092 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:23.479910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:23.514442 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be224-b3eb-4204-ac00-b9cd68de6422 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:23.514633 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850defbc-33bc-4cae-a8e5-af7b277b7512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:23.515296 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850defbc-33bc-4cae-a8e5-af7b277b7512 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.515570 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850defbc-33bc-4cae-a8e5-af7b277b7512 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.515837 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850defbc-33bc-4cae-a8e5-af7b277b7512 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.535898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850defbc-33bc-4cae-a8e5-af7b277b7512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-850defbc-33bc-4cae-a8e5-af7b277b7512 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:23.545840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:23.546816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:23.547582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 91/185] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:23.553462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850defbc-33bc-4cae-a8e5-af7b277b7512 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:23.556053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef41b71-3e53-495b-839b-cd18b0f93713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:23.557103 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef41b71-3e53-495b-839b-cd18b0f93713 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.557642 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef41b71-3e53-495b-839b-cd18b0f93713 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.558245 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef41b71-3e53-495b-839b-cd18b0f93713 None admin] PATH_INFO: `/v3/projects/c67c7c49a672495e81a9cd13125938de` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.559960 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef41b71-3e53-495b-839b-cd18b0f93713 None admin] RBAC: Authorizing `identity:get_project(project_id=c67c7c49a672495e81a9cd13125938de)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:23.561583 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef41b71-3e53-495b-839b-cd18b0f93713 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:23.563522 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 95/186] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:23 2022] GET /identity/v3/projects/c67c7c49a672495e81a9cd13125938de => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:23.569867 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef41b71-3e53-495b-839b-cd18b0f93713 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:23.688209 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef41b71-3e53-495b-839b-cd18b0f93713 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:23.707084 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850defbc-33bc-4cae-a8e5-af7b277b7512 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:23.728184 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ba16-1dc0-450b-8e14-9d072b820d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:23.729062 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ba16-1dc0-450b-8e14-9d072b820d56 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.729505 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ba16-1dc0-450b-8e14-9d072b820d56 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.730119 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9ba16-1dc0-450b-8e14-9d072b820d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.731537 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9ba16-1dc0-450b-8e14-9d072b820d56 None admin] RBAC: Adding query filter params (role.id=d4bd126c45e24b93a90052154a32972b, scope.project.id=c67c7c49a672495e81a9cd13125938de, user.id=e8676f826bd04492bdb84c50b42a20be) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:23.732176 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9ba16-1dc0-450b-8e14-9d072b820d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:23.734313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9ba16-1dc0-450b-8e14-9d072b820d56 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:23.737818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:23.746677 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 96/187] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:23 2022] GET /identity/v3/role_assignments?user.id=e8676f826bd04492bdb84c50b42a20be&scope.project.id=c67c7c49a672495e81a9cd13125938de&role.id=d4bd126c45e24b93a90052154a32972b => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:23.747959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ba16-1dc0-450b-8e14-9d072b820d56 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:23.767869 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4aa8-6c1c-4de5-8a15-53a7e3d364d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:23.768598 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4aa8-6c1c-4de5-8a15-53a7e3d364d5 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.769029 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4aa8-6c1c-4de5-8a15-53a7e3d364d5 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.769432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4aa8-6c1c-4de5-8a15-53a7e3d364d5 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.770369 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac4aa8-6c1c-4de5-8a15-53a7e3d364d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:23.770801 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac4aa8-6c1c-4de5-8a15-53a7e3d364d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:23.772554 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac4aa8-6c1c-4de5-8a15-53a7e3d364d5 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:23.788642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 92/188] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:23.794632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4aa8-6c1c-4de5-8a15-53a7e3d364d5 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:23.881730 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:23.885011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9ba16-1dc0-450b-8e14-9d072b820d56 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:23.976433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912ff4d-bb0b-4121-932b-11e71c855ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:23.977123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912ff4d-bb0b-4121-932b-11e71c855ced None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:23.977397 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912ff4d-bb0b-4121-932b-11e71c855ced None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:23.977663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912ff4d-bb0b-4121-932b-11e71c855ced None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:23.997498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912ff4d-bb0b-4121-932b-11e71c855ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-0912ff4d-bb0b-4121-932b-11e71c855ced None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:24.005638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:24.006611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:24.007392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:24.007981 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 97/189] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:38:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:24.008554 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912ff4d-bb0b-4121-932b-11e71c855ced None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:24.027068 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4aa8-6c1c-4de5-8a15-53a7e3d364d5 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:24.078048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548d690-a2db-464a-ba70-efe784f37bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:24.078759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548d690-a2db-464a-ba70-efe784f37bd8 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:24.078984 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548d690-a2db-464a-ba70-efe784f37bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:24.079269 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548d690-a2db-464a-ba70-efe784f37bd8 None admin] PATH_INFO: `/v3/users/ee56dda8d652463ea5232ee5ede817d2` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:24.097747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548d690-a2db-464a-ba70-efe784f37bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=ee56dda8d652463ea5232ee5ede817d2)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:24.100260 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:24.101412 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548d690-a2db-464a-ba70-efe784f37bd8 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:24.104706 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 93/190] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:23 2022] GET /identity/v3/users/ee56dda8d652463ea5232ee5ede817d2 => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:24.107442 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548d690-a2db-464a-ba70-efe784f37bd8 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:24.162706 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912ff4d-bb0b-4121-932b-11e71c855ced None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:24.201529 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a872b9-58c6-4fe2-9106-f26ac81c685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:24.202306 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a872b9-58c6-4fe2-9106-f26ac81c685d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:24.202582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a872b9-58c6-4fe2-9106-f26ac81c685d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:24.202845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a872b9-58c6-4fe2-9106-f26ac81c685d None admin] PATH_INFO: `/v3/domains/default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:24.203989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a872b9-58c6-4fe2-9106-f26ac81c685d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:24.205787 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a872b9-58c6-4fe2-9106-f26ac81c685d None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:24.212064 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 98/191] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:38:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:24.212676 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a872b9-58c6-4fe2-9106-f26ac81c685d None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:24.240522 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:24.251517 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548d690-a2db-464a-ba70-efe784f37bd8 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:24.294642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43048d82-6fa7-4a32-a4d5-eb1b9d0ed804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:24.295514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048d82-6fa7-4a32-a4d5-eb1b9d0ed804 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:24.295778 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048d82-6fa7-4a32-a4d5-eb1b9d0ed804 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:24.296153 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048d82-6fa7-4a32-a4d5-eb1b9d0ed804 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:24.296718 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43048d82-6fa7-4a32-a4d5-eb1b9d0ed804 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:24.297014 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43048d82-6fa7-4a32-a4d5-eb1b9d0ed804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:24.298431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43048d82-6fa7-4a32-a4d5-eb1b9d0ed804 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:24.313954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 94/192] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:38:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:24.313954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43048d82-6fa7-4a32-a4d5-eb1b9d0ed804 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:24.352469 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a872b9-58c6-4fe2-9106-f26ac81c685d None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:24.387820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:24.397943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9edfb-63a0-4cfe-ad51-4b5dce81d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:24.398614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9edfb-63a0-4cfe-ad51-4b5dce81d340 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:24.398893 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9edfb-63a0-4cfe-ad51-4b5dce81d340 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:24.399164 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9edfb-63a0-4cfe-ad51-4b5dce81d340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:24.443683 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43048d82-6fa7-4a32-a4d5-eb1b9d0ed804 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:24.481228 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9edfb-63a0-4cfe-ad51-4b5dce81d340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:24.482988 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9edfb-63a0-4cfe-ad51-4b5dce81d340 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:24.485281 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb36a1-66b4-4a24-9c6d-70409c0c7ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:24.486446 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb36a1-66b4-4a24-9c6d-70409c0c7ed6 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:24.486833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb36a1-66b4-4a24-9c6d-70409c0c7ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:24.487217 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb36a1-66b4-4a24-9c6d-70409c0c7ed6 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:24.488184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb36a1-66b4-4a24-9c6d-70409c0c7ed6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:24.490205 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb36a1-66b4-4a24-9c6d-70409c0c7ed6 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:24.526087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 95/193] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:38:24 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:24.528437 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb36a1-66b4-4a24-9c6d-70409c0c7ed6 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:24.579291 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:24.632191 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 99/194] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:24.638049 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9edfb-63a0-4cfe-ad51-4b5dce81d340 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:24.681493 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:24.696260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb36a1-66b4-4a24-9c6d-70409c0c7ed6 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:24.740940 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a8a18-e588-43e8-9318-dc2ca4448f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:24.741153 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a8a18-e588-43e8-9318-dc2ca4448f79 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:24.741460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a8a18-e588-43e8-9318-dc2ca4448f79 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:24.741649 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a8a18-e588-43e8-9318-dc2ca4448f79 None admin] PATH_INFO: `/v3/users/ee56dda8d652463ea5232ee5ede817d2` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:24.742843 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a8a18-e588-43e8-9318-dc2ca4448f79 None admin] RBAC: Authorizing `identity:get_user(user_id=ee56dda8d652463ea5232ee5ede817d2)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:24.744309 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a8a18-e588-43e8-9318-dc2ca4448f79 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:24.746642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 96/195] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:24 2022] GET /identity/v3/users/ee56dda8d652463ea5232ee5ede817d2 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:24.754821 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a8a18-e588-43e8-9318-dc2ca4448f79 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:24.793573 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9edfb-63a0-4cfe-ad51-4b5dce81d340 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:24.859607 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d308f6-98ef-44a3-84df-60b3358cd29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:24.860271 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d308f6-98ef-44a3-84df-60b3358cd29a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:24.860548 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d308f6-98ef-44a3-84df-60b3358cd29a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:24.861007 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d308f6-98ef-44a3-84df-60b3358cd29a None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:24.863184 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d308f6-98ef-44a3-84df-60b3358cd29a None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:24.865463 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d308f6-98ef-44a3-84df-60b3358cd29a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:24.868006 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 100/196] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:24 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:24.873513 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:24.875045 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d308f6-98ef-44a3-84df-60b3358cd29a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:24.903149 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a8a18-e588-43e8-9318-dc2ca4448f79 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:24.962886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e0a4d-0e75-4947-ad54-c4e86ba9c938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:24.963596 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0a4d-0e75-4947-ad54-c4e86ba9c938 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:24.964120 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0a4d-0e75-4947-ad54-c4e86ba9c938 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:24.964411 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0a4d-0e75-4947-ad54-c4e86ba9c938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:25.040399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:25.053050 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d308f6-98ef-44a3-84df-60b3358cd29a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:25.077645 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e0a4d-0e75-4947-ad54-c4e86ba9c938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:25.079169 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e0a4d-0e75-4947-ad54-c4e86ba9c938 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:25.100018 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8201147-59a9-4a73-ba00-a8cda1ad2137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:25.101308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8201147-59a9-4a73-ba00-a8cda1ad2137 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:25.102039 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8201147-59a9-4a73-ba00-a8cda1ad2137 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:25.102591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8201147-59a9-4a73-ba00-a8cda1ad2137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:25.103600 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8201147-59a9-4a73-ba00-a8cda1ad2137 None admin] RBAC: Adding query filter params (role.id=d444334199c640a7af820f46e283d49d, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1, user.id=ee56dda8d652463ea5232ee5ede817d2) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:25.104227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8201147-59a9-4a73-ba00-a8cda1ad2137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:25.106222 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8201147-59a9-4a73-ba00-a8cda1ad2137 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:25.113580 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 101/197] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:24 2022] GET /identity/v3/role_assignments?user.id=ee56dda8d652463ea5232ee5ede817d2&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=d444334199c640a7af820f46e283d49d => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:25.182325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:25.208314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 97/198] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 14:38:25.214742 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8201147-59a9-4a73-ba00-a8cda1ad2137 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:25.390701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8201147-59a9-4a73-ba00-a8cda1ad2137 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:25.437162 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d8312-69ee-4795-93f5-be81c3a8ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:25.438291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d8312-69ee-4795-93f5-be81c3a8ac7b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:25.438825 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d8312-69ee-4795-93f5-be81c3a8ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:25.439608 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d8312-69ee-4795-93f5-be81c3a8ac7b None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:25.441269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d8312-69ee-4795-93f5-be81c3a8ac7b None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:25.443226 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d8312-69ee-4795-93f5-be81c3a8ac7b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:25.445434 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 102/199] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:25 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:25.453057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e0a4d-0e75-4947-ad54-c4e86ba9c938 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:25.615005 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e0a4d-0e75-4947-ad54-c4e86ba9c938 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:25.617986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5146175-2314-4a91-a79b-a2a0f7b7d31b None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:25.618569 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5146175-2314-4a91-a79b-a2a0f7b7d31b None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:25.618849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5146175-2314-4a91-a79b-a2a0f7b7d31b None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:25.620561 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 103/200] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:25.625777 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c696f-b52b-48c4-93d2-8de67f9901a1 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:25.626073 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c696f-b52b-48c4-93d2-8de67f9901a1 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:25.626354 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c696f-b52b-48c4-93d2-8de67f9901a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:25.649382 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-a01c696f-b52b-48c4-93d2-8de67f9901a1 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:25.650690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-a01c696f-b52b-48c4-93d2-8de67f9901a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:25.685288 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:25.706169 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df02b-583e-40a7-bf80-dfc5ea76c0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:25.708444 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df02b-583e-40a7-bf80-dfc5ea76c0aa None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:25.709148 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df02b-583e-40a7-bf80-dfc5ea76c0aa None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:25.710186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df02b-583e-40a7-bf80-dfc5ea76c0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:25.713004 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df02b-583e-40a7-bf80-dfc5ea76c0aa None admin] RBAC: Adding query filter params (role.id=d3126a0397e243eeb3aa834efbabf407, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1, user.id=ee56dda8d652463ea5232ee5ede817d2) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:25.714667 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df02b-583e-40a7-bf80-dfc5ea76c0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:25.717430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df02b-583e-40a7-bf80-dfc5ea76c0aa None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:25.725612 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 98/201] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:25 2022] GET /identity/v3/role_assignments?user.id=ee56dda8d652463ea5232ee5ede817d2&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=d3126a0397e243eeb3aa834efbabf407 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:25.798302 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 104/202] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:38:26.165947 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df02b-583e-40a7-bf80-dfc5ea76c0aa None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:26.243741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:26.326423 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df02b-583e-40a7-bf80-dfc5ea76c0aa None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:26.376683 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be1f8c-018a-4784-9644-d5ee7c8fe577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:26.377349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be1f8c-018a-4784-9644-d5ee7c8fe577 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:26.377625 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be1f8c-018a-4784-9644-d5ee7c8fe577 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:26.377898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be1f8c-018a-4784-9644-d5ee7c8fe577 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:26.399865 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be1f8c-018a-4784-9644-d5ee7c8fe577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-39be1f8c-018a-4784-9644-d5ee7c8fe577 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:26.406933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:26.407842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:26.408627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 99/203] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:26.415322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c696f-b52b-48c4-93d2-8de67f9901a1 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:26.544468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c696f-b52b-48c4-93d2-8de67f9901a1 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:26.590329 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2a720-8152-4b5d-a402-1dc16a04e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:26.590921 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2a720-8152-4b5d-a402-1dc16a04e401 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:26.591197 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2a720-8152-4b5d-a402-1dc16a04e401 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:26.591463 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2a720-8152-4b5d-a402-1dc16a04e401 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:26.592137 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2a720-8152-4b5d-a402-1dc16a04e401 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:26.592437 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2a720-8152-4b5d-a402-1dc16a04e401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:26.593861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2a720-8152-4b5d-a402-1dc16a04e401 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:26.603084 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 105/204] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:26.609819 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be1f8c-018a-4784-9644-d5ee7c8fe577 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:26.728102 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be1f8c-018a-4784-9644-d5ee7c8fe577 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:26.731470 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:26.784137 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef1438-991e-463c-bf68-a9906f8dbb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:26.784799 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef1438-991e-463c-bf68-a9906f8dbb87 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:26.785074 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef1438-991e-463c-bf68-a9906f8dbb87 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:26.785340 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef1438-991e-463c-bf68-a9906f8dbb87 None admin] PATH_INFO: `/v3/users/f10848a8538549d3b67d102dec2b25be` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:26.786586 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef1438-991e-463c-bf68-a9906f8dbb87 None admin] RBAC: Authorizing `identity:get_user(user_id=f10848a8538549d3b67d102dec2b25be)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:26.788551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef1438-991e-463c-bf68-a9906f8dbb87 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:26.790415 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 100/205] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:26 2022] GET /identity/v3/users/f10848a8538549d3b67d102dec2b25be => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:26.798867 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2a720-8152-4b5d-a402-1dc16a04e401 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:26.834265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:26.962586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2a720-8152-4b5d-a402-1dc16a04e401 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:27.021383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b6dce-1a37-4c9a-b4cb-d8b1bcbdef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:27.022037 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6dce-1a37-4c9a-b4cb-d8b1bcbdef7f None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:27.022318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6dce-1a37-4c9a-b4cb-d8b1bcbdef7f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:27.022589 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6dce-1a37-4c9a-b4cb-d8b1bcbdef7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:27.110983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b6dce-1a37-4c9a-b4cb-d8b1bcbdef7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:27.112384 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b6dce-1a37-4c9a-b4cb-d8b1bcbdef7f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:27.146374 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:27.229891 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 106/206] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:27.239047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef1438-991e-463c-bf68-a9906f8dbb87 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:27.353627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef1438-991e-463c-bf68-a9906f8dbb87 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:27.393186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe12043-8df9-4805-a5fa-87842e4cee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:27.393861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12043-8df9-4805-a5fa-87842e4cee5d None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:27.394171 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12043-8df9-4805-a5fa-87842e4cee5d None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:27.394446 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12043-8df9-4805-a5fa-87842e4cee5d None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:27.395783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe12043-8df9-4805-a5fa-87842e4cee5d None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:27.397245 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe12043-8df9-4805-a5fa-87842e4cee5d None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:27.398939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 101/207] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:27 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:27.405974 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b6dce-1a37-4c9a-b4cb-d8b1bcbdef7f None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:27.521577 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b6dce-1a37-4c9a-b4cb-d8b1bcbdef7f None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:27.543871 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:27.559018 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c370db-4f43-4321-819c-6c68ed23ab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:27.559659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c370db-4f43-4321-819c-6c68ed23ab0b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:27.559985 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c370db-4f43-4321-819c-6c68ed23ab0b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:27.560419 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c370db-4f43-4321-819c-6c68ed23ab0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:27.561322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c370db-4f43-4321-819c-6c68ed23ab0b None admin] RBAC: Adding query filter params (role.id=6a16969a32c74a0cb50a64ae9973c938, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b, user.id=f10848a8538549d3b67d102dec2b25be) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:27.562150 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c370db-4f43-4321-819c-6c68ed23ab0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:27.563793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c370db-4f43-4321-819c-6c68ed23ab0b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:27.571113 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 107/208] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:27 2022] GET /identity/v3/role_assignments?user.id=f10848a8538549d3b67d102dec2b25be&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=6a16969a32c74a0cb50a64ae9973c938 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:27.956096 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576214b1-e944-4de8-b562-8ff69f342ac6 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:27.956615 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576214b1-e944-4de8-b562-8ff69f342ac6 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:27.956615 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576214b1-e944-4de8-b562-8ff69f342ac6 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:27.958283 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 102/209] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:27.964928 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b745-7553-4c37-a931-13e2b7fb3141 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:27.965644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b745-7553-4c37-a931-13e2b7fb3141 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:27.965644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b745-7553-4c37-a931-13e2b7fb3141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:27.988435 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-3ca6b745-7553-4c37-a931-13e2b7fb3141 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:27.989635 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-3ca6b745-7553-4c37-a931-13e2b7fb3141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:27.995048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372c194-d736-42f6-8888-f3dbbc5ce5d0 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:27.995341 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372c194-d736-42f6-8888-f3dbbc5ce5d0 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:27.995666 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372c194-d736-42f6-8888-f3dbbc5ce5d0 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:27.997250 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 103/210] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:28.002898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971d13f-fb88-4766-8c82-0fec41fd7e2e None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:28.003166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971d13f-fb88-4766-8c82-0fec41fd7e2e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:28.003447 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971d13f-fb88-4766-8c82-0fec41fd7e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:28.026105 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-0971d13f-fb88-4766-8c82-0fec41fd7e2e None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:28.027359 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-0971d13f-fb88-4766-8c82-0fec41fd7e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:28.075592 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:28.089359 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 108/211] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:28.123047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 104/212] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:28.281605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720585d3-db2d-4ce9-b365-924467f5eed5 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:28.282341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720585d3-db2d-4ce9-b365-924467f5eed5 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:28.282812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720585d3-db2d-4ce9-b365-924467f5eed5 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:28.284604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 109/213] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:28.290015 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523800d-2cdf-44e4-9d68-d77c8b92ad48 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:28.290554 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523800d-2cdf-44e4-9d68-d77c8b92ad48 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:28.291033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523800d-2cdf-44e4-9d68-d77c8b92ad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:28.310475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-5523800d-2cdf-44e4-9d68-d77c8b92ad48 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:28.312099 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-5523800d-2cdf-44e4-9d68-d77c8b92ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:28.392973 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 105/214] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:28.453747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720585d3-db2d-4ce9-b365-924467f5eed5 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:28.537882 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523800d-2cdf-44e4-9d68-d77c8b92ad48 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:28.565081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720585d3-db2d-4ce9-b365-924467f5eed5 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:28.581637 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:28.604832 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f9271-9de4-4f61-814a-a3c89a4c9c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:28.605464 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f9271-9de4-4f61-814a-a3c89a4c9c21 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:28.605738 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f9271-9de4-4f61-814a-a3c89a4c9c21 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:28.606211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f9271-9de4-4f61-814a-a3c89a4c9c21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:28.607151 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f9271-9de4-4f61-814a-a3c89a4c9c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:28.608601 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f9271-9de4-4f61-814a-a3c89a4c9c21 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:28.610672 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 110/215] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:38:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:28.611715 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b84dd-8280-4642-ad35-fd6f0958e721 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:28.611938 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b84dd-8280-4642-ad35-fd6f0958e721 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:28.612281 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b84dd-8280-4642-ad35-fd6f0958e721 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:28.613946 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 111/216] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:28.615608 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b84dd-8280-4642-ad35-fd6f0958e721 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:28.650696 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:28.653646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523800d-2cdf-44e4-9d68-d77c8b92ad48 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:28.693768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df70428-503d-488c-8fa7-3ff4bb93b5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:28.694690 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df70428-503d-488c-8fa7-3ff4bb93b5bf None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:28.694962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df70428-503d-488c-8fa7-3ff4bb93b5bf None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:28.695222 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df70428-503d-488c-8fa7-3ff4bb93b5bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:28.707226 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df70428-503d-488c-8fa7-3ff4bb93b5bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-3df70428-503d-488c-8fa7-3ff4bb93b5bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:28.712038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:28.712908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:28.713802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 106/217] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:38:28.715375 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d84f-3c91-4907-a456-94f1a69a94fc None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:28.715653 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d84f-3c91-4907-a456-94f1a69a94fc None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:28.715923 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d84f-3c91-4907-a456-94f1a69a94fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:28.733703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-c9c9d84f-3c91-4907-a456-94f1a69a94fc None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:28.734947 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c9c9d84f-3c91-4907-a456-94f1a69a94fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:28.736354 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b84dd-8280-4642-ad35-fd6f0958e721 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:28.778294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176a031-b557-4d50-b270-bdd9e02931bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:28.778847 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176a031-b557-4d50-b270-bdd9e02931bc None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:28.779121 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176a031-b557-4d50-b270-bdd9e02931bc None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:28.779391 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176a031-b557-4d50-b270-bdd9e02931bc None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:28.780056 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176a031-b557-4d50-b270-bdd9e02931bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:28.781514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176a031-b557-4d50-b270-bdd9e02931bc None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:28.806492 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 112/218] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:38:28 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:28.807688 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176a031-b557-4d50-b270-bdd9e02931bc None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:28.830662 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 107/219] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:28.831721 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d84f-3c91-4907-a456-94f1a69a94fc None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:28.868033 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:28.960433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176a031-b557-4d50-b270-bdd9e02931bc None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:28.981169 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:29.000749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d84f-3c91-4907-a456-94f1a69a94fc None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:29.013053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866accc-6707-478b-be36-ef2d9f968119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:29.013840 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866accc-6707-478b-be36-ef2d9f968119 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:29.014247 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866accc-6707-478b-be36-ef2d9f968119 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:29.014850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866accc-6707-478b-be36-ef2d9f968119 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:29.015700 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866accc-6707-478b-be36-ef2d9f968119 None admin] RBAC: Adding query filter params (name=member) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:29.016002 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866accc-6707-478b-be36-ef2d9f968119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:29.017508 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866accc-6707-478b-be36-ef2d9f968119 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:29.027827 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 113/220] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:29.033475 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866accc-6707-478b-be36-ef2d9f968119 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:29.046498 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0b43-97b8-44b6-9220-306bc1218796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:29.047143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0b43-97b8-44b6-9220-306bc1218796 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:29.047413 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0b43-97b8-44b6-9220-306bc1218796 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:29.047675 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0b43-97b8-44b6-9220-306bc1218796 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:29.060279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d0b43-97b8-44b6-9220-306bc1218796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-c77d0b43-97b8-44b6-9220-306bc1218796 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:29.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:29.066685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:29.067585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 108/221] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:38:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:29.073895 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0b43-97b8-44b6-9220-306bc1218796 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:29.165992 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:29.174307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866accc-6707-478b-be36-ef2d9f968119 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:29.204027 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0b43-97b8-44b6-9220-306bc1218796 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:29.215603 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bf3cb-8c74-46de-bada-227130d80154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:29.216251 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bf3cb-8c74-46de-bada-227130d80154 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:29.216528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bf3cb-8c74-46de-bada-227130d80154 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:29.216793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bf3cb-8c74-46de-bada-227130d80154 None admin] PATH_INFO: `/v3/users/698c315692b84cc0a3a71e71734d8839` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:29.236334 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bf3cb-8c74-46de-bada-227130d80154 None admin] RBAC: Authorizing `identity:get_user(user_id=698c315692b84cc0a3a71e71734d8839)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:29.238876 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bf3cb-8c74-46de-bada-227130d80154 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:29.240859 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 114/222] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:29 2022] GET /identity/v3/users/698c315692b84cc0a3a71e71734d8839 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:29.241875 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bf3cb-8c74-46de-bada-227130d80154 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:29.242673 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856efe-5b13-462c-a713-7a9612d6e796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:29.243301 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856efe-5b13-462c-a713-7a9612d6e796 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:29.243577 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856efe-5b13-462c-a713-7a9612d6e796 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:29.243845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856efe-5b13-462c-a713-7a9612d6e796 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:29.244623 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856efe-5b13-462c-a713-7a9612d6e796 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:29.244885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856efe-5b13-462c-a713-7a9612d6e796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:29.246302 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856efe-5b13-462c-a713-7a9612d6e796 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:29.256145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 109/223] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:29.257062 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856efe-5b13-462c-a713-7a9612d6e796 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:29.273578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:29.378699 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bf3cb-8c74-46de-bada-227130d80154 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:29.384801 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856efe-5b13-462c-a713-7a9612d6e796 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:29.416742 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a2751-c206-448b-a89a-16e3d6795449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:29.417636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a2751-c206-448b-a89a-16e3d6795449 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:29.418096 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a2751-c206-448b-a89a-16e3d6795449 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:29.418499 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a2751-c206-448b-a89a-16e3d6795449 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:29.431026 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea657a-d33b-4fe5-9a4a-d7274b433e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:29.431633 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a2751-c206-448b-a89a-16e3d6795449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:29.431750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea657a-d33b-4fe5-9a4a-d7274b433e2b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:29.431920 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea657a-d33b-4fe5-9a4a-d7274b433e2b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:29.432470 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea657a-d33b-4fe5-9a4a-d7274b433e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-924a2751-c206-448b-a89a-16e3d6795449 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:29.437265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:29.438404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:29.439729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:29.446588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 115/224] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:38:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:29.447706 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a2751-c206-448b-a89a-16e3d6795449 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:29.471562 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:29.536522 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea657a-d33b-4fe5-9a4a-d7274b433e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:29.538315 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea657a-d33b-4fe5-9a4a-d7274b433e2b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:29.558628 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:29.580079 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a2751-c206-448b-a89a-16e3d6795449 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:29.634438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50586e6-21b9-41e9-b9a8-c5012ed88078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:29.635160 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50586e6-21b9-41e9-b9a8-c5012ed88078 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:29.635675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50586e6-21b9-41e9-b9a8-c5012ed88078 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:29.636006 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50586e6-21b9-41e9-b9a8-c5012ed88078 None admin] PATH_INFO: `/v3/users/ee56dda8d652463ea5232ee5ede817d2` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:29.637293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50586e6-21b9-41e9-b9a8-c5012ed88078 None admin] RBAC: Authorizing `identity:get_user(user_id=ee56dda8d652463ea5232ee5ede817d2)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:29.639144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50586e6-21b9-41e9-b9a8-c5012ed88078 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:29.641577 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 116/225] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:29 2022] GET /identity/v3/users/ee56dda8d652463ea5232ee5ede817d2 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:29.642687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50586e6-21b9-41e9-b9a8-c5012ed88078 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:29.692964 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 110/226] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:29.694707 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea657a-d33b-4fe5-9a4a-d7274b433e2b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:29.746574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:29.764159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50586e6-21b9-41e9-b9a8-c5012ed88078 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:29.804621 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404fe28-c030-4b68-a2d2-547ea5b1516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:29.805391 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404fe28-c030-4b68-a2d2-547ea5b1516d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:29.805754 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404fe28-c030-4b68-a2d2-547ea5b1516d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:29.806161 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404fe28-c030-4b68-a2d2-547ea5b1516d None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:29.806927 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404fe28-c030-4b68-a2d2-547ea5b1516d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:29.807683 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404fe28-c030-4b68-a2d2-547ea5b1516d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:29.809147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404fe28-c030-4b68-a2d2-547ea5b1516d None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:29.819623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 117/227] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:38:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:29.820593 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404fe28-c030-4b68-a2d2-547ea5b1516d None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:29.826761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea657a-d33b-4fe5-9a4a-d7274b433e2b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:29.845755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:29.865136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b7861-727b-401f-8685-8c56be81ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:29.865874 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b7861-727b-401f-8685-8c56be81ca58 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:29.866208 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b7861-727b-401f-8685-8c56be81ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:29.866500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b7861-727b-401f-8685-8c56be81ca58 None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:29.867624 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b7861-727b-401f-8685-8c56be81ca58 None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:29.869276 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b7861-727b-401f-8685-8c56be81ca58 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:29.871235 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 111/228] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:29 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:29.871877 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b7861-727b-401f-8685-8c56be81ca58 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:29.927685 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404fe28-c030-4b68-a2d2-547ea5b1516d None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:29.962720 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec5fe-b5ee-46a4-9da7-a18250216df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:29.963395 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec5fe-b5ee-46a4-9da7-a18250216df4 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:29.963666 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec5fe-b5ee-46a4-9da7-a18250216df4 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:29.963927 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec5fe-b5ee-46a4-9da7-a18250216df4 None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:29.965131 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ec5fe-b5ee-46a4-9da7-a18250216df4 None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:29.966631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ec5fe-b5ee-46a4-9da7-a18250216df4 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:29.968278 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 118/229] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:29 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:29.969017 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec5fe-b5ee-46a4-9da7-a18250216df4 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:29.984649 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b7861-727b-401f-8685-8c56be81ca58 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:29.988145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:30.023671 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0aeec3-af4f-4a01-af87-e3b52a3e3a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:30.024317 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0aeec3-af4f-4a01-af87-e3b52a3e3a69 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:30.024597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0aeec3-af4f-4a01-af87-e3b52a3e3a69 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:30.024873 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0aeec3-af4f-4a01-af87-e3b52a3e3a69 None admin] PATH_INFO: `/v3/users/ee56dda8d652463ea5232ee5ede817d2` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:30.026319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0aeec3-af4f-4a01-af87-e3b52a3e3a69 None admin] RBAC: Authorizing `identity:get_user(user_id=ee56dda8d652463ea5232ee5ede817d2)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:30.027955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0aeec3-af4f-4a01-af87-e3b52a3e3a69 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:30.030131 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 112/230] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:29 2022] GET /identity/v3/users/ee56dda8d652463ea5232ee5ede817d2 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:30.031355 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0aeec3-af4f-4a01-af87-e3b52a3e3a69 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:30.078014 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec5fe-b5ee-46a4-9da7-a18250216df4 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:30.102257 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:30.126644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92831b6c-1ed1-42d5-86fd-5931358ad2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:30.127749 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92831b6c-1ed1-42d5-86fd-5931358ad2ac None admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:30.128257 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92831b6c-1ed1-42d5-86fd-5931358ad2ac None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:30.128725 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92831b6c-1ed1-42d5-86fd-5931358ad2ac None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/users/ee56dda8d652463ea5232ee5ede817d2/roles/d444334199c640a7af820f46e283d49d` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:30.132233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92831b6c-1ed1-42d5-86fd-5931358ad2ac None admin] RBAC: Authorizing `identity:create_grant(project_id=3a551dfadb7041dd8a9c66dc25bc02a1, user_id=ee56dda8d652463ea5232ee5ede817d2, role_id=d444334199c640a7af820f46e283d49d)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:30.134828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92831b6c-1ed1-42d5-86fd-5931358ad2ac None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:30.157130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 119/231] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:38:29 2022] PUT /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/users/ee56dda8d652463ea5232ee5ede817d2/roles/d444334199c640a7af820f46e283d49d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:30.158464 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92831b6c-1ed1-42d5-86fd-5931358ad2ac None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:30.158884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0aeec3-af4f-4a01-af87-e3b52a3e3a69 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:30.205482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0aff76-f5bb-47fa-add3-e6e0fc3639cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:30.211603 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aff76-f5bb-47fa-add3-e6e0fc3639cf None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:30.211967 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aff76-f5bb-47fa-add3-e6e0fc3639cf None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:30.212174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aff76-f5bb-47fa-add3-e6e0fc3639cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:30.212989 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0aff76-f5bb-47fa-add3-e6e0fc3639cf None admin] RBAC: Adding query filter params (role.id=d4bd126c45e24b93a90052154a32972b, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1, user.id=698c315692b84cc0a3a71e71734d8839) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:30.213341 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0aff76-f5bb-47fa-add3-e6e0fc3639cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:30.215703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0aff76-f5bb-47fa-add3-e6e0fc3639cf None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:30.232679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 113/232] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:30 2022] GET /identity/v3/role_assignments?user.id=698c315692b84cc0a3a71e71734d8839&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=d4bd126c45e24b93a90052154a32972b => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:30.281656 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:30.310901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92831b6c-1ed1-42d5-86fd-5931358ad2ac None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:30.364397 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbede23-6a6d-4816-9fc4-f7c61ff62483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:30.365476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbede23-6a6d-4816-9fc4-f7c61ff62483 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:30.366023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbede23-6a6d-4816-9fc4-f7c61ff62483 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:30.366549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbede23-6a6d-4816-9fc4-f7c61ff62483 None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:30.370502 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbede23-6a6d-4816-9fc4-f7c61ff62483 None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:30.372382 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbede23-6a6d-4816-9fc4-f7c61ff62483 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:30.374580 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 120/233] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:30 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:30.387999 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0aff76-f5bb-47fa-add3-e6e0fc3639cf None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:30.523148 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0aff76-f5bb-47fa-add3-e6e0fc3639cf None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:30.539716 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:30.563243 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf9b3f-fa7c-47d7-b017-bf0b6a5e798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:30.564361 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9b3f-fa7c-47d7-b017-bf0b6a5e798a None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:30.564652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9b3f-fa7c-47d7-b017-bf0b6a5e798a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:30.564928 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9b3f-fa7c-47d7-b017-bf0b6a5e798a None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/users/ee56dda8d652463ea5232ee5ede817d2/roles/d3126a0397e243eeb3aa834efbabf407` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:30.567182 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf9b3f-fa7c-47d7-b017-bf0b6a5e798a None admin] RBAC: Authorizing `identity:create_grant(project_id=3a551dfadb7041dd8a9c66dc25bc02a1, user_id=ee56dda8d652463ea5232ee5ede817d2, role_id=d3126a0397e243eeb3aa834efbabf407)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:30.568641 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf9b3f-fa7c-47d7-b017-bf0b6a5e798a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:30.587249 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 114/234] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:38:30 2022] PUT /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/users/ee56dda8d652463ea5232ee5ede817d2/roles/d3126a0397e243eeb3aa834efbabf407 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 14:38:31.576338 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8035e07-89e5-4060-a375-d0b0b32edc88 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:31.576850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8035e07-89e5-4060-a375-d0b0b32edc88 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:31.576850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8035e07-89e5-4060-a375-d0b0b32edc88 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:31.578258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 121/235] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:31.588106 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3f3f-f608-4684-9dd2-021910cb4500 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:31.588678 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3f3f-f608-4684-9dd2-021910cb4500 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:31.588957 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3f3f-f608-4684-9dd2-021910cb4500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:31.615505 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-fe0c3f3f-f608-4684-9dd2-021910cb4500 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:31.617254 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-fe0c3f3f-f608-4684-9dd2-021910cb4500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:31.747654 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 115/236] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:31.791642 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e4d1-1438-4212-bafb-403654d6dd07 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:31.792075 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e4d1-1438-4212-bafb-403654d6dd07 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:31.792312 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e4d1-1438-4212-bafb-403654d6dd07 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:31.793776 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 122/237] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:31.806084 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114097-ff48-426b-ba0a-443bf0b38cb1 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:31.806292 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114097-ff48-426b-ba0a-443bf0b38cb1 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:31.806496 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114097-ff48-426b-ba0a-443bf0b38cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:31.831325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-26114097-ff48-426b-ba0a-443bf0b38cb1 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:31.832666 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-26114097-ff48-426b-ba0a-443bf0b38cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:31.924513 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 116/238] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:32.213358 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6e4d1-1438-4212-bafb-403654d6dd07 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:32.356344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26114097-ff48-426b-ba0a-443bf0b38cb1 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:32.358841 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6e4d1-1438-4212-bafb-403654d6dd07 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:32.434803 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6b249-ee39-4ad5-ba98-cb163fec8c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:32.436514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6b249-ee39-4ad5-ba98-cb163fec8c76 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:32.439563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6b249-ee39-4ad5-ba98-cb163fec8c76 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:32.441333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6b249-ee39-4ad5-ba98-cb163fec8c76 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:32.442139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:32.466952 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6b249-ee39-4ad5-ba98-cb163fec8c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-96f6b249-ee39-4ad5-ba98-cb163fec8c76 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:32.472644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:32.473496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:32.474340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:32.476572 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 123/239] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:32.482722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6b249-ee39-4ad5-ba98-cb163fec8c76 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:32.487848 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:32.610120 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26114097-ff48-426b-ba0a-443bf0b38cb1 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:32.629410 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6b249-ee39-4ad5-ba98-cb163fec8c76 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:32.671303 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2f985-b772-43ba-847a-feb31050ee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:32.671992 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2f985-b772-43ba-847a-feb31050ee9a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:32.672266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2f985-b772-43ba-847a-feb31050ee9a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:32.672531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2f985-b772-43ba-847a-feb31050ee9a None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:32.673222 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2f985-b772-43ba-847a-feb31050ee9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:32.673516 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2f985-b772-43ba-847a-feb31050ee9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:32.675397 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2f985-b772-43ba-847a-feb31050ee9a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:32.686335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 124/240] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:32.693223 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31e4d0-a04e-4d14-9cd9-88c92c13d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:32.694850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2f985-b772-43ba-847a-feb31050ee9a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:32.695723 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31e4d0-a04e-4d14-9cd9-88c92c13d2c1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:32.696026 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31e4d0-a04e-4d14-9cd9-88c92c13d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:32.696292 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31e4d0-a04e-4d14-9cd9-88c92c13d2c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:32.699556 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31e4d0-a04e-4d14-9cd9-88c92c13d2c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:32.701065 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31e4d0-a04e-4d14-9cd9-88c92c13d2c1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:32.708487 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 117/241] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:38:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:32.709469 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31e4d0-a04e-4d14-9cd9-88c92c13d2c1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:32.842336 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:32.859371 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:32.864053 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31e4d0-a04e-4d14-9cd9-88c92c13d2c1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:32.891753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2f985-b772-43ba-847a-feb31050ee9a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:32.904765 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c40c45-ea77-405c-923b-9c8bce799bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:32.905808 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40c45-ea77-405c-923b-9c8bce799bc1 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:32.906305 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40c45-ea77-405c-923b-9c8bce799bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:32.907027 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40c45-ea77-405c-923b-9c8bce799bc1 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:32.908179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c40c45-ea77-405c-923b-9c8bce799bc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:32.909996 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c40c45-ea77-405c-923b-9c8bce799bc1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:32.930700 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653198e-6420-4550-bb6a-df8d50b84d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:32.931297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653198e-6420-4550-bb6a-df8d50b84d9b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:32.931535 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653198e-6420-4550-bb6a-df8d50b84d9b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:32.931802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653198e-6420-4550-bb6a-df8d50b84d9b None admin] PATH_INFO: `/v3/users/755f9a95d1e84e5ebbd3f504de6dbb53` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:32.935739 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 118/242] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:38:32 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:32.937344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280030e-7d9d-4f6f-a276-9535f12706d8 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:32.937856 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280030e-7d9d-4f6f-a276-9535f12706d8 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:32.938493 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280030e-7d9d-4f6f-a276-9535f12706d8 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:32.941856 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 119/243] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:32.947764 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473436f-f129-447d-8903-632b5dfb4d35 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:32.948522 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473436f-f129-447d-8903-632b5dfb4d35 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:32.949074 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473436f-f129-447d-8903-632b5dfb4d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:32.970801 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-c473436f-f129-447d-8903-632b5dfb4d35 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:32.971552 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653198e-6420-4550-bb6a-df8d50b84d9b None admin] RBAC: Authorizing `identity:get_user(user_id=755f9a95d1e84e5ebbd3f504de6dbb53)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:32.972648 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c473436f-f129-447d-8903-632b5dfb4d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:32.973035 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653198e-6420-4550-bb6a-df8d50b84d9b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:32.979685 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 125/244] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:32 2022] GET /identity/v3/users/755f9a95d1e84e5ebbd3f504de6dbb53 => generated 297 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:32.980699 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653198e-6420-4550-bb6a-df8d50b84d9b None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:33.055828 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 120/245] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:33.057858 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c81a3d-82ed-4a45-acaa-913bb1892f4e None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:33.058574 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c81a3d-82ed-4a45-acaa-913bb1892f4e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:33.059332 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c81a3d-82ed-4a45-acaa-913bb1892f4e None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:33.062258 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 121/246] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:33.077851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8e05-4c4d-4c32-bf59-2160f84bbf60 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:33.078191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8e05-4c4d-4c32-bf59-2160f84bbf60 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:33.078430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8e05-4c4d-4c32-bf59-2160f84bbf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:33.113288 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-c44f8e05-4c4d-4c32-bf59-2160f84bbf60 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:33.114475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c44f8e05-4c4d-4c32-bf59-2160f84bbf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:33.183215 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653198e-6420-4550-bb6a-df8d50b84d9b None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:33.221023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:33.229991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 122/247] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:38:33.244224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628435-a3d9-42f0-a283-3dd0d77a1455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:33.246107 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628435-a3d9-42f0-a283-3dd0d77a1455 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:33.246610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628435-a3d9-42f0-a283-3dd0d77a1455 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:33.247061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628435-a3d9-42f0-a283-3dd0d77a1455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:33.326347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79628435-a3d9-42f0-a283-3dd0d77a1455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:33.328254 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79628435-a3d9-42f0-a283-3dd0d77a1455 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:33.455423 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 126/248] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 14:38:33.460905 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f8e05-4c4d-4c32-bf59-2160f84bbf60 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:33.465187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628435-a3d9-42f0-a283-3dd0d77a1455 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:33.490423 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:33.512223 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:33.629712 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628435-a3d9-42f0-a283-3dd0d77a1455 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:33.639503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f8e05-4c4d-4c32-bf59-2160f84bbf60 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:33.680586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2659a-92c2-470b-ba5e-02bf3c413423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:33.681202 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2659a-92c2-470b-ba5e-02bf3c413423 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:33.681478 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2659a-92c2-470b-ba5e-02bf3c413423 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:33.681769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2659a-92c2-470b-ba5e-02bf3c413423 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:33.690456 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747077a-2256-4a3c-b86f-b6baf6315365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:33.691198 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747077a-2256-4a3c-b86f-b6baf6315365 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:33.691473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747077a-2256-4a3c-b86f-b6baf6315365 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:33.691750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747077a-2256-4a3c-b86f-b6baf6315365 None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:33.692880 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747077a-2256-4a3c-b86f-b6baf6315365 None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:33.694097 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2659a-92c2-470b-ba5e-02bf3c413423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:33.694367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747077a-2256-4a3c-b86f-b6baf6315365 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:33.696301 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 123/249] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:33 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:33.697435 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528073d-89c4-4cb1-8a58-1f6339a4360b None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:33.697769 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528073d-89c4-4cb1-8a58-1f6339a4360b None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:33.698484 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528073d-89c4-4cb1-8a58-1f6339a4360b None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:33.699242 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 124/250] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-3bf2659a-92c2-470b-ba5e-02bf3c413423 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:33.699690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:33.700549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:33.701335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:33.702035 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528073d-89c4-4cb1-8a58-1f6339a4360b None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:33.702888 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 127/251] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:38:33.706271 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2659a-92c2-470b-ba5e-02bf3c413423 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:33.818304 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:33.821388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:33.842286 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2659a-92c2-470b-ba5e-02bf3c413423 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:33.843659 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528073d-89c4-4cb1-8a58-1f6339a4360b None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:33.888412 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b92745-9f4d-40eb-98be-f46b36ce3418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:33.889023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b92745-9f4d-40eb-98be-f46b36ce3418 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:33.889327 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b92745-9f4d-40eb-98be-f46b36ce3418 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:33.889605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b92745-9f4d-40eb-98be-f46b36ce3418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:33.890340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b92745-9f4d-40eb-98be-f46b36ce3418 None admin] RBAC: Adding query filter params (role.id=6a16969a32c74a0cb50a64ae9973c938, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1, user.id=755f9a95d1e84e5ebbd3f504de6dbb53) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:33.890617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b92745-9f4d-40eb-98be-f46b36ce3418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:33.892083 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b92745-9f4d-40eb-98be-f46b36ce3418 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:33.892896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780275-485d-4a5c-97be-7e44e88e9c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:33.893764 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780275-485d-4a5c-97be-7e44e88e9c00 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:33.894457 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780275-485d-4a5c-97be-7e44e88e9c00 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:33.894922 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780275-485d-4a5c-97be-7e44e88e9c00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:33.899195 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 128/252] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:33 2022] GET /identity/v3/role_assignments?user.id=755f9a95d1e84e5ebbd3f504de6dbb53&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=6a16969a32c74a0cb50a64ae9973c938 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:33.900571 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce605b4-d452-4767-b86c-eeb43c573c56 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:33.900967 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce605b4-d452-4767-b86c-eeb43c573c56 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:33.901363 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce605b4-d452-4767-b86c-eeb43c573c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:33.909366 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7780275-485d-4a5c-97be-7e44e88e9c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-c7780275-485d-4a5c-97be-7e44e88e9c00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:33.916047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:33.917080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:33.917867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:33.921308 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 125/253] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:33.922411 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780275-485d-4a5c-97be-7e44e88e9c00 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:33.931124 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-dce605b4-d452-4767-b86c-eeb43c573c56 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:33.932600 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-dce605b4-d452-4767-b86c-eeb43c573c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:34.082877 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 129/254] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:34.083611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce605b4-d452-4767-b86c-eeb43c573c56 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:34.140974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780275-485d-4a5c-97be-7e44e88e9c00 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:34.194538 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:34.220217 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce605b4-d452-4767-b86c-eeb43c573c56 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:34.227450 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e3a38-7573-4d99-9ba3-de824b613022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:34.228082 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e3a38-7573-4d99-9ba3-de824b613022 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:34.228356 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e3a38-7573-4d99-9ba3-de824b613022 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:34.228623 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e3a38-7573-4d99-9ba3-de824b613022 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:34.229336 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e3a38-7573-4d99-9ba3-de824b613022 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:34.229631 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e3a38-7573-4d99-9ba3-de824b613022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:34.231059 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e3a38-7573-4d99-9ba3-de824b613022 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:34.248888 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 126/255] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:34.263657 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e3a38-7573-4d99-9ba3-de824b613022 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:34.269393 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a74d83-b64d-43e7-a79f-000c5a86d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:34.270300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a74d83-b64d-43e7-a79f-000c5a86d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:34.270859 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a74d83-b64d-43e7-a79f-000c5a86d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:34.271478 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a74d83-b64d-43e7-a79f-000c5a86d0c7 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:34.273054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a74d83-b64d-43e7-a79f-000c5a86d0c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:34.273769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a74d83-b64d-43e7-a79f-000c5a86d0c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:34.275398 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a74d83-b64d-43e7-a79f-000c5a86d0c7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:34.286806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:34.296538 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 130/256] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:34.300784 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a74d83-b64d-43e7-a79f-000c5a86d0c7 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:34.455177 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a74d83-b64d-43e7-a79f-000c5a86d0c7 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:34.458846 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e3a38-7573-4d99-9ba3-de824b613022 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:34.496849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f65b-b13d-43fa-a210-3374e859e2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:34.497494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f65b-b13d-43fa-a210-3374e859e2c5 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:34.497768 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f65b-b13d-43fa-a210-3374e859e2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:34.498069 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f65b-b13d-43fa-a210-3374e859e2c5 None admin] PATH_INFO: `/v3/users/698c315692b84cc0a3a71e71734d8839` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:34.499378 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6f65b-b13d-43fa-a210-3374e859e2c5 None admin] RBAC: Authorizing `identity:get_user(user_id=698c315692b84cc0a3a71e71734d8839)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:34.501572 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6f65b-b13d-43fa-a210-3374e859e2c5 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:34.503560 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 131/257] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:34 2022] GET /identity/v3/users/698c315692b84cc0a3a71e71734d8839 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:34.504344 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f65b-b13d-43fa-a210-3374e859e2c5 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:34.522628 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:34.546623 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d925e-44a9-41bf-bceb-9decfa74fc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:34.547273 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d925e-44a9-41bf-bceb-9decfa74fc83 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:34.547547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d925e-44a9-41bf-bceb-9decfa74fc83 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:34.547816 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d925e-44a9-41bf-bceb-9decfa74fc83 None admin] PATH_INFO: `/v3/users/ee56dda8d652463ea5232ee5ede817d2` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:34.548993 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d925e-44a9-41bf-bceb-9decfa74fc83 None admin] RBAC: Authorizing `identity:get_user(user_id=ee56dda8d652463ea5232ee5ede817d2)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:34.550588 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d925e-44a9-41bf-bceb-9decfa74fc83 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:34.552311 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 127/258] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:34 2022] GET /identity/v3/users/ee56dda8d652463ea5232ee5ede817d2 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:34.553068 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d925e-44a9-41bf-bceb-9decfa74fc83 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:34.623519 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f65b-b13d-43fa-a210-3374e859e2c5 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:34.661224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6665bb8-0a56-4dfc-8ccd-2eb2e31bc3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:34.661850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6665bb8-0a56-4dfc-8ccd-2eb2e31bc3e0 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:34.662158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6665bb8-0a56-4dfc-8ccd-2eb2e31bc3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:34.663408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6665bb8-0a56-4dfc-8ccd-2eb2e31bc3e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:34.675083 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6665bb8-0a56-4dfc-8ccd-2eb2e31bc3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-c6665bb8-0a56-4dfc-8ccd-2eb2e31bc3e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:34.681599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:34.682618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:34.683432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 132/259] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:38:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:34.684157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6665bb8-0a56-4dfc-8ccd-2eb2e31bc3e0 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:34.766382 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:34.780329 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:34.808234 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6665bb8-0a56-4dfc-8ccd-2eb2e31bc3e0 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:34.850162 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03120e3b-f808-4477-9818-d35c8391a9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:34.851028 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03120e3b-f808-4477-9818-d35c8391a9e2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:34.851442 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03120e3b-f808-4477-9818-d35c8391a9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:34.851576 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d925e-44a9-41bf-bceb-9decfa74fc83 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:34.851971 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03120e3b-f808-4477-9818-d35c8391a9e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:34.940722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8615-90f2-4048-8cef-21c0ae72436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:34.941414 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8615-90f2-4048-8cef-21c0ae72436b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:34.941696 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8615-90f2-4048-8cef-21c0ae72436b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:34.942330 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8615-90f2-4048-8cef-21c0ae72436b None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:34.944564 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8615-90f2-4048-8cef-21c0ae72436b None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:34.946093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8615-90f2-4048-8cef-21c0ae72436b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:34.947893 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 128/260] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:34 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:34.952037 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8615-90f2-4048-8cef-21c0ae72436b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:34.988121 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03120e3b-f808-4477-9818-d35c8391a9e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:34.989629 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03120e3b-f808-4477-9818-d35c8391a9e2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:35.135131 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:35.161767 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8615-90f2-4048-8cef-21c0ae72436b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:35.204346 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 133/261] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:35.206383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03120e3b-f808-4477-9818-d35c8391a9e2 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:35.240794 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a4120-239c-4ff5-9c59-635c2203f23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:35.241661 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a4120-239c-4ff5-9c59-635c2203f23c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:35.242097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a4120-239c-4ff5-9c59-635c2203f23c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:35.242499 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a4120-239c-4ff5-9c59-635c2203f23c None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:35.243300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a4120-239c-4ff5-9c59-635c2203f23c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:35.243762 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a4120-239c-4ff5-9c59-635c2203f23c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:35.246735 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a4120-239c-4ff5-9c59-635c2203f23c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:35.258894 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 129/262] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:38:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:35.259952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a4120-239c-4ff5-9c59-635c2203f23c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:35.268996 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:35.382141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a4120-239c-4ff5-9c59-635c2203f23c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:35.421287 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a975a0d-af22-4f71-8d44-232df2227c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:35.422447 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a975a0d-af22-4f71-8d44-232df2227c01 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:35.422938 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a975a0d-af22-4f71-8d44-232df2227c01 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:35.423481 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a975a0d-af22-4f71-8d44-232df2227c01 None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:35.424939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a975a0d-af22-4f71-8d44-232df2227c01 None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:35.426632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a975a0d-af22-4f71-8d44-232df2227c01 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:35.428978 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 130/263] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:35 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:35.430898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a975a0d-af22-4f71-8d44-232df2227c01 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:35.519989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03120e3b-f808-4477-9818-d35c8391a9e2 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:35.524191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:35.579310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a975a0d-af22-4f71-8d44-232df2227c01 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:35.589037 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104d263-961c-434d-81d8-83b2e387eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:35.589934 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104d263-961c-434d-81d8-83b2e387eb56 None admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:35.590068 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104d263-961c-434d-81d8-83b2e387eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:35.590294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104d263-961c-434d-81d8-83b2e387eb56 None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/users/698c315692b84cc0a3a71e71734d8839/roles/d4bd126c45e24b93a90052154a32972b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:35.592265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104d263-961c-434d-81d8-83b2e387eb56 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a551dfadb7041dd8a9c66dc25bc02a1, user_id=698c315692b84cc0a3a71e71734d8839, role_id=d4bd126c45e24b93a90052154a32972b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:35.593725 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104d263-961c-434d-81d8-83b2e387eb56 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:35.622257 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f1849-e029-4c41-9d77-e1a65d8b736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:35.623716 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f1849-e029-4c41-9d77-e1a65d8b736f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:35.624792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 134/264] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:38:35 2022] PUT /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/users/698c315692b84cc0a3a71e71734d8839/roles/d4bd126c45e24b93a90052154a32972b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:35.625310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f1849-e029-4c41-9d77-e1a65d8b736f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:35.625767 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f1849-e029-4c41-9d77-e1a65d8b736f None admin] PATH_INFO: `/v3/users/ee56dda8d652463ea5232ee5ede817d2` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:35.626816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104d263-961c-434d-81d8-83b2e387eb56 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:35.629744 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f1849-e029-4c41-9d77-e1a65d8b736f None admin] RBAC: Authorizing `identity:get_user(user_id=ee56dda8d652463ea5232ee5ede817d2)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:35.633768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f1849-e029-4c41-9d77-e1a65d8b736f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:35.646337 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 131/265] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:35 2022] GET /identity/v3/users/ee56dda8d652463ea5232ee5ede817d2 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:35.663740 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f1849-e029-4c41-9d77-e1a65d8b736f None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:35.702354 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:35.868595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f1849-e029-4c41-9d77-e1a65d8b736f None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:35.909390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedef6e-eba9-4d47-9aa8-3d3deafe1e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:35.909956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedef6e-eba9-4d47-9aa8-3d3deafe1e92 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:35.910236 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedef6e-eba9-4d47-9aa8-3d3deafe1e92 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:35.910503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedef6e-eba9-4d47-9aa8-3d3deafe1e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:35.924127 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:35.940438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104d263-961c-434d-81d8-83b2e387eb56 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:35.996196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedef6e-eba9-4d47-9aa8-3d3deafe1e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:35.998598 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedef6e-eba9-4d47-9aa8-3d3deafe1e92 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:36.067492 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fad9d-c262-4ee5-ad13-a51fb818a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:36.068100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fad9d-c262-4ee5-ad13-a51fb818a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:36.068383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fad9d-c262-4ee5-ad13-a51fb818a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:36.068654 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fad9d-c262-4ee5-ad13-a51fb818a3c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:36.069400 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fad9d-c262-4ee5-ad13-a51fb818a3c2 None admin] RBAC: Adding query filter params (role.id=d444334199c640a7af820f46e283d49d, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1, user.id=ee56dda8d652463ea5232ee5ede817d2) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:36.069711 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fad9d-c262-4ee5-ad13-a51fb818a3c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:36.071294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fad9d-c262-4ee5-ad13-a51fb818a3c2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:36.084487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 135/266] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:35 2022] GET /identity/v3/role_assignments?user.id=ee56dda8d652463ea5232ee5ede817d2&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=d444334199c640a7af820f46e283d49d => generated 608 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:36.169317 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 132/267] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:36.179315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fad9d-c262-4ee5-ad13-a51fb818a3c2 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:36.298278 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179edd94-803f-477a-88c4-45d349f36f89 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:36.298649 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179edd94-803f-477a-88c4-45d349f36f89 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:36.298861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179edd94-803f-477a-88c4-45d349f36f89 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:36.300412 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 133/268] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:36.311845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77326d-8ce9-4c4d-9bb8-8cccd58b7a95 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:36.312144 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77326d-8ce9-4c4d-9bb8-8cccd58b7a95 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:36.312384 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77326d-8ce9-4c4d-9bb8-8cccd58b7a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:36.326319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:36.341490 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fad9d-c262-4ee5-ad13-a51fb818a3c2 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:36.343593 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-1f77326d-8ce9-4c4d-9bb8-8cccd58b7a95 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:36.344834 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-1f77326d-8ce9-4c4d-9bb8-8cccd58b7a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:36.438885 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4ea57-6774-4176-a7a0-6497c6896548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:36.440574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ea57-6774-4176-a7a0-6497c6896548 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:36.441618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ea57-6774-4176-a7a0-6497c6896548 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:36.442636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ea57-6774-4176-a7a0-6497c6896548 None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:36.445313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4ea57-6774-4176-a7a0-6497c6896548 None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:36.445964 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:36.450849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4ea57-6774-4176-a7a0-6497c6896548 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:36.459314 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 136/269] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:36 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:36.462527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4ea57-6774-4176-a7a0-6497c6896548 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:36.535986 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 134/270] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:38:36.597579 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4ea57-6774-4176-a7a0-6497c6896548 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:36.649781 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cbaa5-02f0-46a8-8660-844c7a4e7745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:36.650879 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cbaa5-02f0-46a8-8660-844c7a4e7745 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:36.651358 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cbaa5-02f0-46a8-8660-844c7a4e7745 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:36.651824 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cbaa5-02f0-46a8-8660-844c7a4e7745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:36.652765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cbaa5-02f0-46a8-8660-844c7a4e7745 None admin] RBAC: Adding query filter params (role.id=d3126a0397e243eeb3aa834efbabf407, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1, user.id=ee56dda8d652463ea5232ee5ede817d2) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:36.653302 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cbaa5-02f0-46a8-8660-844c7a4e7745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:36.654992 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cbaa5-02f0-46a8-8660-844c7a4e7745 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:36.662303 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 137/271] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:36 2022] GET /identity/v3/role_assignments?user.id=ee56dda8d652463ea5232ee5ede817d2&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=d3126a0397e243eeb3aa834efbabf407 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:36.672898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70d6c-42ea-4393-a165-fea255801882 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:36.673223 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70d6c-42ea-4393-a165-fea255801882 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:36.673461 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70d6c-42ea-4393-a165-fea255801882 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:36.677250 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 135/272] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:36.682159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d16a9-7ffe-4e55-9135-873d37bf0965 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:36.682481 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d16a9-7ffe-4e55-9135-873d37bf0965 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:36.682714 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d16a9-7ffe-4e55-9135-873d37bf0965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:36.711223 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-199d16a9-7ffe-4e55-9135-873d37bf0965 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:36.713334 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-199d16a9-7ffe-4e55-9135-873d37bf0965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:36.739970 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:36.813194 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 138/273] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:36.863595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a4285-4056-4be7-b055-31b2e0f943c7 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:36.863940 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a4285-4056-4be7-b055-31b2e0f943c7 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:36.864145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a4285-4056-4be7-b055-31b2e0f943c7 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:36.865831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 136/274] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:36.871853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21f707-dea3-4924-a771-ea2fe6e7562f None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:36.872148 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21f707-dea3-4924-a771-ea2fe6e7562f None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:36.872408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21f707-dea3-4924-a771-ea2fe6e7562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:36.900008 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-2b21f707-dea3-4924-a771-ea2fe6e7562f None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:36.901381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-2b21f707-dea3-4924-a771-ea2fe6e7562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:36.973141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a4285-4056-4be7-b055-31b2e0f943c7 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:37.000212 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 139/275] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:37.138875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a4285-4056-4be7-b055-31b2e0f943c7 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:37.177826 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a577f35-9d02-4d12-828a-15bdf83e6116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:37.178548 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577f35-9d02-4d12-828a-15bdf83e6116 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:37.178825 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577f35-9d02-4d12-828a-15bdf83e6116 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:37.179157 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577f35-9d02-4d12-828a-15bdf83e6116 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:37.191467 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a577f35-9d02-4d12-828a-15bdf83e6116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-5a577f35-9d02-4d12-828a-15bdf83e6116 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:37.196497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:37.197364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:37.198687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 137/276] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:38:37.199923 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21f707-dea3-4924-a771-ea2fe6e7562f None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:37.203991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a577f35-9d02-4d12-828a-15bdf83e6116 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:37.243378 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:37.318697 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:37.337969 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a577f35-9d02-4d12-828a-15bdf83e6116 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:37.345331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21f707-dea3-4924-a771-ea2fe6e7562f None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:37.387520 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a83ed-c4af-47c3-bcf2-ff3ca12e0257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:37.387704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a83ed-c4af-47c3-bcf2-ff3ca12e0257 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:37.388109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a83ed-c4af-47c3-bcf2-ff3ca12e0257 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:37.388387 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a83ed-c4af-47c3-bcf2-ff3ca12e0257 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:37.389156 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a83ed-c4af-47c3-bcf2-ff3ca12e0257 None admin] RBAC: Adding query filter params (name=member) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:37.389464 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a83ed-c4af-47c3-bcf2-ff3ca12e0257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:37.391109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a83ed-c4af-47c3-bcf2-ff3ca12e0257 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:37.392164 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d8f0-96f6-4710-85bd-cd74679a0fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:37.393693 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d8f0-96f6-4710-85bd-cd74679a0fd7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:37.394640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d8f0-96f6-4710-85bd-cd74679a0fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:37.395079 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d8f0-96f6-4710-85bd-cd74679a0fd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:37.396406 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1d8f0-96f6-4710-85bd-cd74679a0fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:37.398625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1d8f0-96f6-4710-85bd-cd74679a0fd7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:37.400745 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 140/277] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:38:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:37.400935 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 138/278] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:37.401808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d8f0-96f6-4710-85bd-cd74679a0fd7 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:37.407175 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a83ed-c4af-47c3-bcf2-ff3ca12e0257 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:37.510462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:37.523535 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d8f0-96f6-4710-85bd-cd74679a0fd7 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:37.523733 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a83ed-c4af-47c3-bcf2-ff3ca12e0257 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:37.563243 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34aa31-03f4-4899-bbaf-d85f091ef8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:37.563886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34aa31-03f4-4899-bbaf-d85f091ef8d3 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:37.564470 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34aa31-03f4-4899-bbaf-d85f091ef8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:37.564742 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34aa31-03f4-4899-bbaf-d85f091ef8d3 None admin] PATH_INFO: `/v3/users/5fb976af5606457a9eb16d110e3fa724` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:37.565132 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352f92d-3888-4da9-be97-544839099197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:37.565833 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f92d-3888-4da9-be97-544839099197 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:37.566206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f92d-3888-4da9-be97-544839099197 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:37.566543 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f92d-3888-4da9-be97-544839099197 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:37.577383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352f92d-3888-4da9-be97-544839099197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:37.579348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34aa31-03f4-4899-bbaf-d85f091ef8d3 None admin] RBAC: Authorizing `identity:get_user(user_id=5fb976af5606457a9eb16d110e3fa724)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:37.580822 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34aa31-03f4-4899-bbaf-d85f091ef8d3 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-7352f92d-3888-4da9-be97-544839099197 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:37.582299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:37.583365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:37.584388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:37.584978 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 139/279] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:37 2022] GET /identity/v3/users/5fb976af5606457a9eb16d110e3fa724 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:37.584978 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34aa31-03f4-4899-bbaf-d85f091ef8d3 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:37.590002 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 141/280] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:37.590002 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352f92d-3888-4da9-be97-544839099197 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:37.608849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:37.715435 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34aa31-03f4-4899-bbaf-d85f091ef8d3 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:37.719449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352f92d-3888-4da9-be97-544839099197 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:37.761508 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1262e6-b5a7-4b3e-8d5f-ce756ee6d48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:37.762213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1262e6-b5a7-4b3e-8d5f-ce756ee6d48a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:37.762491 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1262e6-b5a7-4b3e-8d5f-ce756ee6d48a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:37.762759 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1262e6-b5a7-4b3e-8d5f-ce756ee6d48a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:37.763359 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834a99-6c43-4ebd-a315-29585592c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:37.763532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1262e6-b5a7-4b3e-8d5f-ce756ee6d48a None admin] RBAC: Adding query filter params (role.id=d4bd126c45e24b93a90052154a32972b, user.id=5fb976af5606457a9eb16d110e3fa724, scope.system=all) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:37.763792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1262e6-b5a7-4b3e-8d5f-ce756ee6d48a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:37.763977 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834a99-6c43-4ebd-a315-29585592c36d None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:37.764254 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834a99-6c43-4ebd-a315-29585592c36d None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:37.764524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834a99-6c43-4ebd-a315-29585592c36d None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:37.765172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2834a99-6c43-4ebd-a315-29585592c36d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:37.765271 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1262e6-b5a7-4b3e-8d5f-ce756ee6d48a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:37.766667 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2834a99-6c43-4ebd-a315-29585592c36d None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:37.778533 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 142/281] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Aug 19 14:38:37 2022] GET /identity/v3/role_assignments?user.id=5fb976af5606457a9eb16d110e3fa724&scope.system=all&role.id=d4bd126c45e24b93a90052154a32972b => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:37.778533 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1262e6-b5a7-4b3e-8d5f-ce756ee6d48a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:37.799226 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 140/282] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:38:37 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:37.904603 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:37.936076 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1262e6-b5a7-4b3e-8d5f-ce756ee6d48a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:37.978799 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8123-6701-4e85-a583-d58102b7d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:37.979825 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8123-6701-4e85-a583-d58102b7d350 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:37.980327 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8123-6701-4e85-a583-d58102b7d350 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:37.980815 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8123-6701-4e85-a583-d58102b7d350 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:37.981731 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8123-6701-4e85-a583-d58102b7d350 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:37.982329 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8123-6701-4e85-a583-d58102b7d350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:37.984023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8123-6701-4e85-a583-d58102b7d350 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:37.995032 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 143/283] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:38.001284 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834a99-6c43-4ebd-a315-29585592c36d None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:38.016802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:38.135194 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834a99-6c43-4ebd-a315-29585592c36d None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:38.172528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5a5b5-81b4-45f4-817b-85ce962952f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:38.173411 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5a5b5-81b4-45f4-817b-85ce962952f6 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:38.173683 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5a5b5-81b4-45f4-817b-85ce962952f6 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:38.173998 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5a5b5-81b4-45f4-817b-85ce962952f6 None admin] PATH_INFO: `/v3/users/755f9a95d1e84e5ebbd3f504de6dbb53` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:38.175304 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5a5b5-81b4-45f4-817b-85ce962952f6 None admin] RBAC: Authorizing `identity:get_user(user_id=755f9a95d1e84e5ebbd3f504de6dbb53)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:38.176899 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5a5b5-81b4-45f4-817b-85ce962952f6 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:38.178828 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 141/284] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:38 2022] GET /identity/v3/users/755f9a95d1e84e5ebbd3f504de6dbb53 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:38.185075 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8123-6701-4e85-a583-d58102b7d350 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:38.303430 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8123-6701-4e85-a583-d58102b7d350 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:38.341536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf07ec-1f2e-44dd-b902-fe84b62aa55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:38.342809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf07ec-1f2e-44dd-b902-fe84b62aa55f None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:38.343286 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf07ec-1f2e-44dd-b902-fe84b62aa55f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:38.343751 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf07ec-1f2e-44dd-b902-fe84b62aa55f None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:38.345162 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf07ec-1f2e-44dd-b902-fe84b62aa55f None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:38.346904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf07ec-1f2e-44dd-b902-fe84b62aa55f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:38.348798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 144/285] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:38 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:38.354902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5a5b5-81b4-45f4-817b-85ce962952f6 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:38.486674 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:38.529310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5a5b5-81b4-45f4-817b-85ce962952f6 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:38.575129 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c3d1-bdab-43a6-b21f-29bb40725f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:38.575750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c3d1-bdab-43a6-b21f-29bb40725f43 None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:38.576211 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c3d1-bdab-43a6-b21f-29bb40725f43 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:38.576649 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c3d1-bdab-43a6-b21f-29bb40725f43 None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/users/755f9a95d1e84e5ebbd3f504de6dbb53/roles/6a16969a32c74a0cb50a64ae9973c938` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:38.580130 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91c3d1-bdab-43a6-b21f-29bb40725f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a551dfadb7041dd8a9c66dc25bc02a1, user_id=755f9a95d1e84e5ebbd3f504de6dbb53, role_id=6a16969a32c74a0cb50a64ae9973c938)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:38.582920 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91c3d1-bdab-43a6-b21f-29bb40725f43 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:38.602022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 142/286] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:38:38 2022] PUT /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/users/755f9a95d1e84e5ebbd3f504de6dbb53/roles/6a16969a32c74a0cb50a64ae9973c938 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:38.661445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cdf7c-8168-4855-adf9-2a9e9e3d220b None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:38.661796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cdf7c-8168-4855-adf9-2a9e9e3d220b None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:38.662086 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cdf7c-8168-4855-adf9-2a9e9e3d220b None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:38.663701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 145/287] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:38.672452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f8caf-f279-4aad-b36f-ba73bd15a867 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:38.672774 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f8caf-f279-4aad-b36f-ba73bd15a867 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:38.672993 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f8caf-f279-4aad-b36f-ba73bd15a867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:38.704517 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-1b3f8caf-f279-4aad-b36f-ba73bd15a867 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:38.705740 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-1b3f8caf-f279-4aad-b36f-ba73bd15a867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:38.802046 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 143/288] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:39.239117 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cdf7c-8168-4855-adf9-2a9e9e3d220b None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:39.249802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:39.373769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cdf7c-8168-4855-adf9-2a9e9e3d220b None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:39.437237 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83cd72-3bd6-4afd-8890-6905fffe91a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:39.437893 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83cd72-3bd6-4afd-8890-6905fffe91a1 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:39.438185 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83cd72-3bd6-4afd-8890-6905fffe91a1 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:39.438456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83cd72-3bd6-4afd-8890-6905fffe91a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:39.450750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83cd72-3bd6-4afd-8890-6905fffe91a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-af83cd72-3bd6-4afd-8890-6905fffe91a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:39.456242 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:39.457127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:39.457901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 146/289] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:39.465095 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f8caf-f279-4aad-b36f-ba73bd15a867 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:39.592135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:39.633120 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f8caf-f279-4aad-b36f-ba73bd15a867 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:39.675427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f97eb-13e9-4491-b1a0-e62f572fc303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:39.676045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f97eb-13e9-4491-b1a0-e62f572fc303 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:39.676316 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f97eb-13e9-4491-b1a0-e62f572fc303 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:39.676580 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f97eb-13e9-4491-b1a0-e62f572fc303 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:39.677245 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f97eb-13e9-4491-b1a0-e62f572fc303 None admin] RBAC: Adding query filter params (name=member) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:39.677543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f97eb-13e9-4491-b1a0-e62f572fc303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:39.678973 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f97eb-13e9-4491-b1a0-e62f572fc303 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:39.688864 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 144/290] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:39.694912 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83cd72-3bd6-4afd-8890-6905fffe91a1 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:39.786195 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:39.831677 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83cd72-3bd6-4afd-8890-6905fffe91a1 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:39.900149 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83f9cd-d9f8-4d8a-a0d3-c8116a9785db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:39.900737 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83f9cd-d9f8-4d8a-a0d3-c8116a9785db None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:39.901037 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83f9cd-d9f8-4d8a-a0d3-c8116a9785db None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:39.901256 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83f9cd-d9f8-4d8a-a0d3-c8116a9785db None admin] PATH_INFO: `/v3/users/698c315692b84cc0a3a71e71734d8839` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:39.906864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83f9cd-d9f8-4d8a-a0d3-c8116a9785db None admin] RBAC: Authorizing `identity:get_user(user_id=698c315692b84cc0a3a71e71734d8839)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:39.908382 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83f9cd-d9f8-4d8a-a0d3-c8116a9785db None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:39.910366 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 147/291] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:39 2022] GET /identity/v3/users/698c315692b84cc0a3a71e71734d8839 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:39.919102 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f97eb-13e9-4491-b1a0-e62f572fc303 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:40.098753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f97eb-13e9-4491-b1a0-e62f572fc303 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:40.146916 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:40.157985 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae4d8-8a2e-4acf-9828-a4b335215785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:40.159117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae4d8-8a2e-4acf-9828-a4b335215785 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:40.159616 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae4d8-8a2e-4acf-9828-a4b335215785 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:40.160071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae4d8-8a2e-4acf-9828-a4b335215785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:40.235083 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccae4d8-8a2e-4acf-9828-a4b335215785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:40.236941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccae4d8-8a2e-4acf-9828-a4b335215785 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:40.392852 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 145/292] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:40.398770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83f9cd-d9f8-4d8a-a0d3-c8116a9785db None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:40.552817 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83f9cd-d9f8-4d8a-a0d3-c8116a9785db None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:40.604718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58116ab0-edd2-40bc-b472-cdc281eff3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:40.605363 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116ab0-edd2-40bc-b472-cdc281eff3b1 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:40.605637 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116ab0-edd2-40bc-b472-cdc281eff3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:40.605899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116ab0-edd2-40bc-b472-cdc281eff3b1 None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:40.607080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58116ab0-edd2-40bc-b472-cdc281eff3b1 None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:40.608544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58116ab0-edd2-40bc-b472-cdc281eff3b1 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:40.610217 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 148/293] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:40 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:40.616208 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae4d8-8a2e-4acf-9828-a4b335215785 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:40.660831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:40.782633 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae4d8-8a2e-4acf-9828-a4b335215785 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:40.831594 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbe449-b035-4ef2-92c8-b081c3f86cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:40.832551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe449-b035-4ef2-92c8-b081c3f86cf3 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:40.833033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe449-b035-4ef2-92c8-b081c3f86cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:40.833500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe449-b035-4ef2-92c8-b081c3f86cf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:40.834446 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbe449-b035-4ef2-92c8-b081c3f86cf3 None admin] RBAC: Adding query filter params (role.id=d4bd126c45e24b93a90052154a32972b, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1, user.id=698c315692b84cc0a3a71e71734d8839) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:40.834955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbe449-b035-4ef2-92c8-b081c3f86cf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:40.836594 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbe449-b035-4ef2-92c8-b081c3f86cf3 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:40.846515 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 146/294] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:40 2022] GET /identity/v3/role_assignments?user.id=698c315692b84cc0a3a71e71734d8839&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=d4bd126c45e24b93a90052154a32972b => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:40.852553 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067fd62-c6a8-4f3a-8ce5-30981d92acad None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:40.852829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067fd62-c6a8-4f3a-8ce5-30981d92acad None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:40.853272 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067fd62-c6a8-4f3a-8ce5-30981d92acad None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:40.855481 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 149/295] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:40.861624 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efdc3-2461-46c3-9077-c72be61b4ee8 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:40.862023 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efdc3-2461-46c3-9077-c72be61b4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:40.862198 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efdc3-2461-46c3-9077-c72be61b4ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:40.891427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-9e4efdc3-2461-46c3-9077-c72be61b4ee8 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:40.892693 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-9e4efdc3-2461-46c3-9077-c72be61b4ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:40.908079 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3762514-3009-4b08-9eff-17bfc93d66dd None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:40.908422 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3762514-3009-4b08-9eff-17bfc93d66dd None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:40.908604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3762514-3009-4b08-9eff-17bfc93d66dd None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:40.910171 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 150/296] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:38:40.918000 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe980-8387-47a8-95ac-11b28b9be4e8 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:40.918325 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe980-8387-47a8-95ac-11b28b9be4e8 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:40.918535 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe980-8387-47a8-95ac-11b28b9be4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:40.933295 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:40.954640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-73fbe980-8387-47a8-95ac-11b28b9be4e8 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:40.955943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-73fbe980-8387-47a8-95ac-11b28b9be4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:41.009493 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 147/297] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:41.077635 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 151/298] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:38:41.287987 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0a208-e6cb-424a-980c-4fc81f5f3f85 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:41.288250 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0a208-e6cb-424a-980c-4fc81f5f3f85 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:41.288605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0a208-e6cb-424a-980c-4fc81f5f3f85 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:41.290262 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 148/299] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:41.296808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c13a66-1b6c-44ea-9a59-336ee8b33049 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:41.297156 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c13a66-1b6c-44ea-9a59-336ee8b33049 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:41.297436 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c13a66-1b6c-44ea-9a59-336ee8b33049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:41.323516 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-e8c13a66-1b6c-44ea-9a59-336ee8b33049 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:41.324718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-e8c13a66-1b6c-44ea-9a59-336ee8b33049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:41.367436 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0a208-e6cb-424a-980c-4fc81f5f3f85 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:41.401954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:41.436342 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 152/300] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:41.455788 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c13a66-1b6c-44ea-9a59-336ee8b33049 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:41.524320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0a208-e6cb-424a-980c-4fc81f5f3f85 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:41.554592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:41.565360 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507378d-23d6-4e6d-af0a-f9f136531474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:41.566274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507378d-23d6-4e6d-af0a-f9f136531474 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:41.566641 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507378d-23d6-4e6d-af0a-f9f136531474 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:41.567002 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507378d-23d6-4e6d-af0a-f9f136531474 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:41.580728 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507378d-23d6-4e6d-af0a-f9f136531474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-6507378d-23d6-4e6d-af0a-f9f136531474 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:41.586195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:41.587755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:41.589974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 149/301] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:41.599208 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507378d-23d6-4e6d-af0a-f9f136531474 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:41.610457 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c13a66-1b6c-44ea-9a59-336ee8b33049 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:41.670182 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c54946-2cf7-4150-bc5a-4d3080237a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:41.671555 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c54946-2cf7-4150-bc5a-4d3080237a8d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:41.671958 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c54946-2cf7-4150-bc5a-4d3080237a8d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:41.672308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c54946-2cf7-4150-bc5a-4d3080237a8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:41.695295 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c54946-2cf7-4150-bc5a-4d3080237a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-a2c54946-2cf7-4150-bc5a-4d3080237a8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:41.702591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:41.703487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:41.704794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 153/302] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:38:41.705960 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11dd47-4f98-498d-a53b-9f83e2affb63 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:41.706611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11dd47-4f98-498d-a53b-9f83e2affb63 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:41.706909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11dd47-4f98-498d-a53b-9f83e2affb63 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:41.708685 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 154/303] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:41.716153 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11dd47-4f98-498d-a53b-9f83e2affb63 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:41.729777 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:41.759399 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507378d-23d6-4e6d-af0a-f9f136531474 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:41.807458 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed9243-ea93-4c83-87e9-be92a745493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:41.808118 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed9243-ea93-4c83-87e9-be92a745493b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:41.808411 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed9243-ea93-4c83-87e9-be92a745493b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:41.808661 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed9243-ea93-4c83-87e9-be92a745493b None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:41.809349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed9243-ea93-4c83-87e9-be92a745493b None admin] RBAC: Adding query filter params (name=member) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:41.809658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed9243-ea93-4c83-87e9-be92a745493b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:41.811323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed9243-ea93-4c83-87e9-be92a745493b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:41.821987 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 150/304] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:41.823597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a9034-9db1-4914-8926-5cbb77086daf None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:41.823876 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a9034-9db1-4914-8926-5cbb77086daf None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:41.824142 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a9034-9db1-4914-8926-5cbb77086daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:41.845169 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-624a9034-9db1-4914-8926-5cbb77086daf None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:41.846758 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-624a9034-9db1-4914-8926-5cbb77086daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:41.856786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11dd47-4f98-498d-a53b-9f83e2affb63 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:41.883584 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:41.899095 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d31c03-04d4-436a-acf6-58b7375a69d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:41.899785 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d31c03-04d4-436a-acf6-58b7375a69d2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:41.900037 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d31c03-04d4-436a-acf6-58b7375a69d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:41.900300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d31c03-04d4-436a-acf6-58b7375a69d2 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:41.901974 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d31c03-04d4-436a-acf6-58b7375a69d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:41.902329 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d31c03-04d4-436a-acf6-58b7375a69d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:41.903754 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d31c03-04d4-436a-acf6-58b7375a69d2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:41.913385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 155/305] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:41.914663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d31c03-04d4-436a-acf6-58b7375a69d2 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:41.938525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 151/306] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:41.939785 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a9034-9db1-4914-8926-5cbb77086daf None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:42.026455 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:42.038946 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d31c03-04d4-436a-acf6-58b7375a69d2 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:42.066448 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a9034-9db1-4914-8926-5cbb77086daf None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:42.080299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017a46-4d1c-447a-8f2b-76991c52bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:42.081372 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017a46-4d1c-447a-8f2b-76991c52bd53 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:42.081650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017a46-4d1c-447a-8f2b-76991c52bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:42.082717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017a46-4d1c-447a-8f2b-76991c52bd53 None admin] PATH_INFO: `/v3/users/5fb976af5606457a9eb16d110e3fa724` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:42.083964 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017a46-4d1c-447a-8f2b-76991c52bd53 None admin] RBAC: Authorizing `identity:get_user(user_id=5fb976af5606457a9eb16d110e3fa724)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:42.085785 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017a46-4d1c-447a-8f2b-76991c52bd53 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:42.087938 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 156/307] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:41 2022] GET /identity/v3/users/5fb976af5606457a9eb16d110e3fa724 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:42.089241 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017a46-4d1c-447a-8f2b-76991c52bd53 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:42.109943 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e8e26-868d-423b-8318-4be8a39438ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:42.110983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e8e26-868d-423b-8318-4be8a39438ca None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:42.111464 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e8e26-868d-423b-8318-4be8a39438ca None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:42.111892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e8e26-868d-423b-8318-4be8a39438ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:42.114351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e8e26-868d-423b-8318-4be8a39438ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:42.116012 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e8e26-868d-423b-8318-4be8a39438ca None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:42.117987 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 152/308] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:38:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:42.119121 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e8e26-868d-423b-8318-4be8a39438ca None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:42.167786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:42.231041 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017a46-4d1c-447a-8f2b-76991c52bd53 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:42.250750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e8e26-868d-423b-8318-4be8a39438ca None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:42.276972 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6b32a-37e1-4b32-9080-0be1cd18a9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:42.277616 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6b32a-37e1-4b32-9080-0be1cd18a9f5 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:42.277890 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6b32a-37e1-4b32-9080-0be1cd18a9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:42.278249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6b32a-37e1-4b32-9080-0be1cd18a9f5 None admin] PATH_INFO: `/v3/users/8109ba2eb65c4b7ebe5b6ee18ca83442` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:42.289829 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd47e5-09d5-4322-98c5-eca57e2217b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:42.290509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd47e5-09d5-4322-98c5-eca57e2217b4 None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:42.290768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd47e5-09d5-4322-98c5-eca57e2217b4 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:42.291034 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd47e5-09d5-4322-98c5-eca57e2217b4 None admin] PATH_INFO: `/v3/system/users/5fb976af5606457a9eb16d110e3fa724/roles/d4bd126c45e24b93a90052154a32972b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:42.292540 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd47e5-09d5-4322-98c5-eca57e2217b4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5fb976af5606457a9eb16d110e3fa724, role_id=d4bd126c45e24b93a90052154a32972b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:42.293945 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd47e5-09d5-4322-98c5-eca57e2217b4 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:42.296799 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6b32a-37e1-4b32-9080-0be1cd18a9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=8109ba2eb65c4b7ebe5b6ee18ca83442)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:42.298437 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6b32a-37e1-4b32-9080-0be1cd18a9f5 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:42.305609 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 157/309] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:42 2022] GET /identity/v3/users/8109ba2eb65c4b7ebe5b6ee18ca83442 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:42.305609 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6b32a-37e1-4b32-9080-0be1cd18a9f5 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:42.305881 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 153/310] 10.222.0.60 () {58 vars in 1334 bytes} [Fri Aug 19 14:38:42 2022] PUT /identity/v3/system/users/5fb976af5606457a9eb16d110e3fa724/roles/d4bd126c45e24b93a90052154a32972b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:42.305881 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd47e5-09d5-4322-98c5-eca57e2217b4 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:42.316864 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:42.460412 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6b32a-37e1-4b32-9080-0be1cd18a9f5 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:42.469214 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd47e5-09d5-4322-98c5-eca57e2217b4 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:42.484653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:42.514384 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004370ff-2822-4ab9-a0c5-3069fb03fe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:42.515028 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004370ff-2822-4ab9-a0c5-3069fb03fe06 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:42.515300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004370ff-2822-4ab9-a0c5-3069fb03fe06 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:42.515569 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004370ff-2822-4ab9-a0c5-3069fb03fe06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:42.531479 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004370ff-2822-4ab9-a0c5-3069fb03fe06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:42.533074 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b002c91-0a8f-4347-ab5a-1b53ee51c91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:42.533699 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b002c91-0a8f-4347-ab5a-1b53ee51c91f None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:42.534109 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b002c91-0a8f-4347-ab5a-1b53ee51c91f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:42.534341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b002c91-0a8f-4347-ab5a-1b53ee51c91f None admin] PATH_INFO: `/v3/groups` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:42.534958 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b002c91-0a8f-4347-ab5a-1b53ee51c91f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:42.536448 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b002c91-0a8f-4347-ab5a-1b53ee51c91f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-004370ff-2822-4ab9-a0c5-3069fb03fe06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:42.539783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:42.543851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 154/311] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:42.544747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004370ff-2822-4ab9-a0c5-3069fb03fe06 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:42.565600 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 158/312] 10.222.0.60 () {60 vars in 1134 bytes} [Fri Aug 19 14:38:42 2022] POST /identity/v3/groups => generated 229 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:42.569901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b002c91-0a8f-4347-ab5a-1b53ee51c91f None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:42.646597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:42.701252 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004370ff-2822-4ab9-a0c5-3069fb03fe06 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:42.744812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b002c91-0a8f-4347-ab5a-1b53ee51c91f None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:42.749865 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb502a9-7d74-44bb-9073-378b7cf7146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:42.750691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb502a9-7d74-44bb-9073-378b7cf7146b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:42.751083 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb502a9-7d74-44bb-9073-378b7cf7146b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:42.751496 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb502a9-7d74-44bb-9073-378b7cf7146b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:42.752362 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb502a9-7d74-44bb-9073-378b7cf7146b None admin] RBAC: Adding query filter params (role.id=6a16969a32c74a0cb50a64ae9973c938, user.id=8109ba2eb65c4b7ebe5b6ee18ca83442, scope.system=all) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:42.752775 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb502a9-7d74-44bb-9073-378b7cf7146b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:42.757597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb502a9-7d74-44bb-9073-378b7cf7146b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:42.769948 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 155/313] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Aug 19 14:38:42 2022] GET /identity/v3/role_assignments?user.id=8109ba2eb65c4b7ebe5b6ee18ca83442&scope.system=all&role.id=6a16969a32c74a0cb50a64ae9973c938 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:42.804530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b54d-ca29-4652-9760-5b6b1b2783a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:42.805203 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b54d-ca29-4652-9760-5b6b1b2783a5 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:42.805482 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b54d-ca29-4652-9760-5b6b1b2783a5 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:42.805751 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b54d-ca29-4652-9760-5b6b1b2783a5 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:42.806510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836b54d-ca29-4652-9760-5b6b1b2783a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:42.806899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836b54d-ca29-4652-9760-5b6b1b2783a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:42.808383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836b54d-ca29-4652-9760-5b6b1b2783a5 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:42.819413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 159/314] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:42.825801 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb502a9-7d74-44bb-9073-378b7cf7146b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:42.959695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb502a9-7d74-44bb-9073-378b7cf7146b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:42.990772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:43.005387 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a254b-f77d-47b6-9df2-f1715c80e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:43.009952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a254b-f77d-47b6-9df2-f1715c80e365 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:43.009952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a254b-f77d-47b6-9df2-f1715c80e365 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:43.009952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a254b-f77d-47b6-9df2-f1715c80e365 None admin] PATH_INFO: `/v3/users/755f9a95d1e84e5ebbd3f504de6dbb53` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:43.009952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a254b-f77d-47b6-9df2-f1715c80e365 None admin] RBAC: Authorizing `identity:get_user(user_id=755f9a95d1e84e5ebbd3f504de6dbb53)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:43.009952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a254b-f77d-47b6-9df2-f1715c80e365 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:43.011644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 156/315] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:42 2022] GET /identity/v3/users/755f9a95d1e84e5ebbd3f504de6dbb53 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:43.017328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b54d-ca29-4652-9760-5b6b1b2783a5 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:43.053196 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:43.129600 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b54d-ca29-4652-9760-5b6b1b2783a5 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:43.166164 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67de0e1-104f-4e0f-83f1-bb25067fca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:43.167131 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67de0e1-104f-4e0f-83f1-bb25067fca76 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:43.167408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67de0e1-104f-4e0f-83f1-bb25067fca76 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:43.167675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67de0e1-104f-4e0f-83f1-bb25067fca76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:43.243259 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67de0e1-104f-4e0f-83f1-bb25067fca76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:43.244831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67de0e1-104f-4e0f-83f1-bb25067fca76 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:43.282307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:43.357156 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 160/316] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:43.362606 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a254b-f77d-47b6-9df2-f1715c80e365 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:43.489407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a254b-f77d-47b6-9df2-f1715c80e365 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:43.527537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d244-3274-4b67-b772-8cc167564daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:43.528183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d244-3274-4b67-b772-8cc167564daa None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:43.528458 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d244-3274-4b67-b772-8cc167564daa None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:43.528730 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d244-3274-4b67-b772-8cc167564daa None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:43.530013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405d244-3274-4b67-b772-8cc167564daa None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:43.531461 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405d244-3274-4b67-b772-8cc167564daa None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:43.533551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 157/317] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:43 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:43.539445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67de0e1-104f-4e0f-83f1-bb25067fca76 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:43.649262 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67de0e1-104f-4e0f-83f1-bb25067fca76 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:43.680491 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:43.686873 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d131e40-b081-4ce8-aeb6-6b8da23aec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:43.687793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d131e40-b081-4ce8-aeb6-6b8da23aec71 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:43.688272 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d131e40-b081-4ce8-aeb6-6b8da23aec71 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:43.688724 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d131e40-b081-4ce8-aeb6-6b8da23aec71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:43.690041 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d131e40-b081-4ce8-aeb6-6b8da23aec71 None admin] RBAC: Adding query filter params (role.id=6a16969a32c74a0cb50a64ae9973c938, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1, user.id=755f9a95d1e84e5ebbd3f504de6dbb53) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:43.690554 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d131e40-b081-4ce8-aeb6-6b8da23aec71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:43.692181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d131e40-b081-4ce8-aeb6-6b8da23aec71 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:43.699115 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 161/318] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:38:43 2022] GET /identity/v3/role_assignments?user.id=755f9a95d1e84e5ebbd3f504de6dbb53&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=6a16969a32c74a0cb50a64ae9973c938 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:44.665346 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434179bb-a578-405d-a2f5-1ac75e177462 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:44.666172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434179bb-a578-405d-a2f5-1ac75e177462 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:44.666172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434179bb-a578-405d-a2f5-1ac75e177462 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:44.667367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 158/319] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:38:44.672726 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ccd08-9719-43d6-9729-7c814cb20c98 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:44.673178 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ccd08-9719-43d6-9729-7c814cb20c98 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:44.673282 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ccd08-9719-43d6-9729-7c814cb20c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:44.695566 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-879ccd08-9719-43d6-9729-7c814cb20c98 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:44.696789 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-879ccd08-9719-43d6-9729-7c814cb20c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:44.780038 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 162/320] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:45.002595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd5050-ad13-4511-9525-60b7e74e3124 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.002894 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd5050-ad13-4511-9525-60b7e74e3124 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.003183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd5050-ad13-4511-9525-60b7e74e3124 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.004627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 159/321] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:45.010257 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5e91a-1861-4bab-8a04-28c1cde1607b None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.010647 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5e91a-1861-4bab-8a04-28c1cde1607b None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.010887 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5e91a-1861-4bab-8a04-28c1cde1607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.029523 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-2ed5e91a-1861-4bab-8a04-28c1cde1607b None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:45.031141 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-2ed5e91a-1861-4bab-8a04-28c1cde1607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:45.068343 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a970-e086-4d0b-a894-605ab33872d5 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.069077 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a970-e086-4d0b-a894-605ab33872d5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.069730 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a970-e086-4d0b-a894-605ab33872d5 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.071772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 160/322] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:45.077239 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468051-3ee8-422a-b549-fb44f3095a82 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.077825 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468051-3ee8-422a-b549-fb44f3095a82 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.078835 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468051-3ee8-422a-b549-fb44f3095a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.103024 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-39468051-3ee8-422a-b549-fb44f3095a82 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:45.105348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-39468051-3ee8-422a-b549-fb44f3095a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:45.105811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 163/323] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:45.126088 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5e91a-1861-4bab-8a04-28c1cde1607b None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:45.177244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:45.190004 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 161/324] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:45.194497 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:45.242775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5e91a-1861-4bab-8a04-28c1cde1607b None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:45.280305 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96ce03-a845-4bd4-8c78-185727166b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:45.281362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96ce03-a845-4bd4-8c78-185727166b87 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.281852 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96ce03-a845-4bd4-8c78-185727166b87 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.282399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96ce03-a845-4bd4-8c78-185727166b87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.294527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96ce03-a845-4bd4-8c78-185727166b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-ec96ce03-a845-4bd4-8c78-185727166b87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:45.299696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:45.300664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:45.301471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:45.302116 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 164/325] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:45.308397 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468051-3ee8-422a-b549-fb44f3095a82 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:45.414582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468051-3ee8-422a-b549-fb44f3095a82 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:45.421676 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96ce03-a845-4bd4-8c78-185727166b87 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:45.454879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db2265-3370-4f56-886a-53bb94bed83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:45.455871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db2265-3370-4f56-886a-53bb94bed83a None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.456368 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db2265-3370-4f56-886a-53bb94bed83a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.456838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db2265-3370-4f56-886a-53bb94bed83a None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.457601 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db2265-3370-4f56-886a-53bb94bed83a None admin] RBAC: Adding query filter params (name=member) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:45.458122 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db2265-3370-4f56-886a-53bb94bed83a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:45.459490 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db2265-3370-4f56-886a-53bb94bed83a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:45.469472 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 162/326] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:45.475259 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db2265-3370-4f56-886a-53bb94bed83a None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:45.540318 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:45.561219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96ce03-a845-4bd4-8c78-185727166b87 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:45.578658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:45.591726 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db2265-3370-4f56-886a-53bb94bed83a None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:45.596876 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f40a2-07dd-4420-b3a9-6b2eb7ef01d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:45.597513 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f40a2-07dd-4420-b3a9-6b2eb7ef01d7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.597787 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f40a2-07dd-4420-b3a9-6b2eb7ef01d7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.598086 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f40a2-07dd-4420-b3a9-6b2eb7ef01d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.599210 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f40a2-07dd-4420-b3a9-6b2eb7ef01d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:45.600748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f40a2-07dd-4420-b3a9-6b2eb7ef01d7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:45.602465 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 165/327] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:45.603801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f40a2-07dd-4420-b3a9-6b2eb7ef01d7 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:45.637864 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568515d-d6db-4570-94b7-f702bc989079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:45.638544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568515d-d6db-4570-94b7-f702bc989079 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.638819 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568515d-d6db-4570-94b7-f702bc989079 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.639075 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568515d-d6db-4570-94b7-f702bc989079 None admin] PATH_INFO: `/v3/users/5fb976af5606457a9eb16d110e3fa724` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.640340 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568515d-d6db-4570-94b7-f702bc989079 None admin] RBAC: Authorizing `identity:get_user(user_id=5fb976af5606457a9eb16d110e3fa724)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:45.649409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568515d-d6db-4570-94b7-f702bc989079 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:45.649409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 163/328] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:45 2022] GET /identity/v3/users/5fb976af5606457a9eb16d110e3fa724 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:45.649409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568515d-d6db-4570-94b7-f702bc989079 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:45.726331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f40a2-07dd-4420-b3a9-6b2eb7ef01d7 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:45.760450 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568515d-d6db-4570-94b7-f702bc989079 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:45.764744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af928222-0a8c-419e-95db-0c520446deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:45.765379 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af928222-0a8c-419e-95db-0c520446deaa None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.765653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af928222-0a8c-419e-95db-0c520446deaa None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.765943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af928222-0a8c-419e-95db-0c520446deaa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.782297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af928222-0a8c-419e-95db-0c520446deaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:45.786714 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-af928222-0a8c-419e-95db-0c520446deaa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:45.787024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:45.787983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:45.788796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 166/329] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:45.789476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af928222-0a8c-419e-95db-0c520446deaa None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:45.802173 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503744c4-37b1-492b-9fff-c83684ae7d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:45.802705 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503744c4-37b1-492b-9fff-c83684ae7d19 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.802977 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503744c4-37b1-492b-9fff-c83684ae7d19 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.803234 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503744c4-37b1-492b-9fff-c83684ae7d19 None admin] PATH_INFO: `/v3/groups` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.803860 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503744c4-37b1-492b-9fff-c83684ae7d19 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:45.805287 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503744c4-37b1-492b-9fff-c83684ae7d19 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:45.823186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 164/330] 10.222.0.60 () {60 vars in 1134 bytes} [Fri Aug 19 14:38:45 2022] POST /identity/v3/groups => generated 226 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:38:45.824257 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503744c4-37b1-492b-9fff-c83684ae7d19 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:45.861273 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:45.942611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af928222-0a8c-419e-95db-0c520446deaa None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:45.962244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503744c4-37b1-492b-9fff-c83684ae7d19 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:45.984155 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf452479-b595-40cc-8293-bd9ea926e7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:45.984777 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf452479-b595-40cc-8293-bd9ea926e7e0 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:45.985050 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf452479-b595-40cc-8293-bd9ea926e7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:45.985315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf452479-b595-40cc-8293-bd9ea926e7e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:45.986098 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf452479-b595-40cc-8293-bd9ea926e7e0 None admin] RBAC: Adding query filter params (role.id=d4bd126c45e24b93a90052154a32972b, user.id=5fb976af5606457a9eb16d110e3fa724, scope.system=all) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:45.986420 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf452479-b595-40cc-8293-bd9ea926e7e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:45.987896 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf452479-b595-40cc-8293-bd9ea926e7e0 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:46.002289 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 167/331] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Aug 19 14:38:45 2022] GET /identity/v3/role_assignments?user.id=5fb976af5606457a9eb16d110e3fa724&scope.system=all&role.id=d4bd126c45e24b93a90052154a32972b => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:46.007562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199717c-8208-4d8b-a59f-88c19bea0ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:46.008171 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199717c-8208-4d8b-a59f-88c19bea0ad1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:46.008440 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199717c-8208-4d8b-a59f-88c19bea0ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:46.008703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199717c-8208-4d8b-a59f-88c19bea0ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:46.009381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199717c-8208-4d8b-a59f-88c19bea0ad1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:46.009681 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199717c-8208-4d8b-a59f-88c19bea0ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:46.011580 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199717c-8208-4d8b-a59f-88c19bea0ad1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:46.022017 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 165/332] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:46.028263 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf452479-b595-40cc-8293-bd9ea926e7e0 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:46.158969 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf452479-b595-40cc-8293-bd9ea926e7e0 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:46.160661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:46.201712 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922dfbc-fed4-468b-a95b-24d51d30cad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:46.202399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922dfbc-fed4-468b-a95b-24d51d30cad2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:46.202673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922dfbc-fed4-468b-a95b-24d51d30cad2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:46.202943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922dfbc-fed4-468b-a95b-24d51d30cad2 None admin] PATH_INFO: `/v3/users/8109ba2eb65c4b7ebe5b6ee18ca83442` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:46.204142 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922dfbc-fed4-468b-a95b-24d51d30cad2 None admin] RBAC: Authorizing `identity:get_user(user_id=8109ba2eb65c4b7ebe5b6ee18ca83442)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:46.205905 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922dfbc-fed4-468b-a95b-24d51d30cad2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:46.207913 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 168/333] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:46 2022] GET /identity/v3/users/8109ba2eb65c4b7ebe5b6ee18ca83442 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:46.213575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199717c-8208-4d8b-a59f-88c19bea0ad1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:46.272231 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:46.334137 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199717c-8208-4d8b-a59f-88c19bea0ad1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:46.382702 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d0ec8-a308-4277-821b-7ec40a30eac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:46.383749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d0ec8-a308-4277-821b-7ec40a30eac9 None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:46.384022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d0ec8-a308-4277-821b-7ec40a30eac9 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:46.384290 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d0ec8-a308-4277-821b-7ec40a30eac9 None admin] PATH_INFO: `/v3/system/users/8109ba2eb65c4b7ebe5b6ee18ca83442/roles/6a16969a32c74a0cb50a64ae9973c938` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:46.385822 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d0ec8-a308-4277-821b-7ec40a30eac9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8109ba2eb65c4b7ebe5b6ee18ca83442, role_id=6a16969a32c74a0cb50a64ae9973c938)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:46.387277 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d0ec8-a308-4277-821b-7ec40a30eac9 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:46.401975 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 166/334] 10.222.0.60 () {58 vars in 1334 bytes} [Fri Aug 19 14:38:46 2022] PUT /identity/v3/system/users/8109ba2eb65c4b7ebe5b6ee18ca83442/roles/6a16969a32c74a0cb50a64ae9973c938 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:48.588095 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920b341-7a2f-495c-8e64-a50686f5c8a0 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:48.588612 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920b341-7a2f-495c-8e64-a50686f5c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:48.588917 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920b341-7a2f-495c-8e64-a50686f5c8a0 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:48.590953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 169/335] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:48.598174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fc86e-665d-4a1f-9e77-ee677e66149e None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:48.599186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fc86e-665d-4a1f-9e77-ee677e66149e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:48.599676 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fc86e-665d-4a1f-9e77-ee677e66149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:48.626190 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-959fc86e-665d-4a1f-9e77-ee677e66149e None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:48.627767 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-959fc86e-665d-4a1f-9e77-ee677e66149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:48.727254 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 167/336] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:38:49.120244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbcd6e-144c-4be8-b2ad-25c7914f4283 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:49.120949 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbcd6e-144c-4be8-b2ad-25c7914f4283 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:49.121427 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbcd6e-144c-4be8-b2ad-25c7914f4283 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:49.123290 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 170/337] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:49.128789 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98522d58-b525-4dac-adbd-cc240cb85d67 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:49.129303 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98522d58-b525-4dac-adbd-cc240cb85d67 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:49.129769 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98522d58-b525-4dac-adbd-cc240cb85d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:49.158919 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-98522d58-b525-4dac-adbd-cc240cb85d67 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:49.160456 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-98522d58-b525-4dac-adbd-cc240cb85d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:49.208820 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:49.260841 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 168/338] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:49.449117 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbcd6e-144c-4be8-b2ad-25c7914f4283 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:49.493682 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e33a1e-2b1c-4dff-91f2-7de0db2bf4a9 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:49.494015 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e33a1e-2b1c-4dff-91f2-7de0db2bf4a9 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:49.494351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e33a1e-2b1c-4dff-91f2-7de0db2bf4a9 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:49.495980 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 169/339] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:49.502506 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c448c4-3f49-4560-8c50-cdbb9531906c None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:49.503275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c448c4-3f49-4560-8c50-cdbb9531906c None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:49.504026 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c448c4-3f49-4560-8c50-cdbb9531906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:49.527896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-06c448c4-3f49-4560-8c50-cdbb9531906c None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:49.529477 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-06c448c4-3f49-4560-8c50-cdbb9531906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:49.617045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 170/340] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:38:49.654760 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbcd6e-144c-4be8-b2ad-25c7914f4283 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:49.697274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75020886-c52d-483f-9bb8-e623e371c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:49.698633 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020886-c52d-483f-9bb8-e623e371c8dc None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:49.698909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020886-c52d-483f-9bb8-e623e371c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:49.699175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020886-c52d-483f-9bb8-e623e371c8dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:49.716216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75020886-c52d-483f-9bb8-e623e371c8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-75020886-c52d-483f-9bb8-e623e371c8dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:49.722861 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:49.723812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:49.724610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:49.725216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 171/341] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:49.732105 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c448c4-3f49-4560-8c50-cdbb9531906c None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:49.732281 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75020886-c52d-483f-9bb8-e623e371c8dc None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:49.816195 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:49.881455 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:49.887316 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c448c4-3f49-4560-8c50-cdbb9531906c None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:49.936357 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aa21d-3720-4e9d-b055-75ef0a6dc006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:49.941952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa21d-3720-4e9d-b055-75ef0a6dc006 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:49.941952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa21d-3720-4e9d-b055-75ef0a6dc006 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:49.941952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa21d-3720-4e9d-b055-75ef0a6dc006 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:49.941952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aa21d-3720-4e9d-b055-75ef0a6dc006 None admin] RBAC: Adding query filter params (name=member) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:49.941952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aa21d-3720-4e9d-b055-75ef0a6dc006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:49.941952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aa21d-3720-4e9d-b055-75ef0a6dc006 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:49.957742 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 171/342] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:49.959501 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10effece-639b-4b61-8f36-13552dfeb1c6 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:49.959970 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10effece-639b-4b61-8f36-13552dfeb1c6 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:49.960432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10effece-639b-4b61-8f36-13552dfeb1c6 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:49.963574 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 172/343] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:49.964640 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10effece-639b-4b61-8f36-13552dfeb1c6 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:49.981031 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75020886-c52d-483f-9bb8-e623e371c8dc None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:50.060506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd9b61-97b3-4967-8615-5e9282fb4d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:50.062596 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9b61-97b3-4967-8615-5e9282fb4d01 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:50.063240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9b61-97b3-4967-8615-5e9282fb4d01 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:50.063671 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9b61-97b3-4967-8615-5e9282fb4d01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:50.081084 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd9b61-97b3-4967-8615-5e9282fb4d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-98fd9b61-97b3-4967-8615-5e9282fb4d01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:50.087267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:50.088319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 14:38:50.089349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:50.092326 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 172/344] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:38:50.094437 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad131d2-2cea-4124-a423-d83807a9289e None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:50.095065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad131d2-2cea-4124-a423-d83807a9289e None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:50.095979 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad131d2-2cea-4124-a423-d83807a9289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:50.116810 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-dad131d2-2cea-4124-a423-d83807a9289e None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:50.118524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-dad131d2-2cea-4124-a423-d83807a9289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:50.156304 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10effece-639b-4b61-8f36-13552dfeb1c6 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:50.202798 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb608d88-5d12-42f8-a833-e5169b1e64f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:50.204022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608d88-5d12-42f8-a833-e5169b1e64f6 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:50.204554 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608d88-5d12-42f8-a833-e5169b1e64f6 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:50.205064 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608d88-5d12-42f8-a833-e5169b1e64f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:50.214612 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 173/345] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:50.215780 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad131d2-2cea-4124-a423-d83807a9289e None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:50.242108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:50.243575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:50.290668 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb608d88-5d12-42f8-a833-e5169b1e64f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:50.292572 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb608d88-5d12-42f8-a833-e5169b1e64f6 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:50.338319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad131d2-2cea-4124-a423-d83807a9289e None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:50.377722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97470e-8659-478a-9c4c-d20385d9ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:50.378444 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97470e-8659-478a-9c4c-d20385d9ab98 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:50.381474 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97470e-8659-478a-9c4c-d20385d9ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:50.381474 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97470e-8659-478a-9c4c-d20385d9ab98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:50.391385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97470e-8659-478a-9c4c-d20385d9ab98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-bf97470e-8659-478a-9c4c-d20385d9ab98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:50.396570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:50.397627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:50.398486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 174/346] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:38:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:50.399171 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97470e-8659-478a-9c4c-d20385d9ab98 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:50.448181 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 173/347] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:50.449544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb608d88-5d12-42f8-a833-e5169b1e64f6 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:50.507005 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:50.532230 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97470e-8659-478a-9c4c-d20385d9ab98 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:50.535595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:50.578604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fe0a1-3f6a-496c-b1b6-d9fb972c4927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:50.579644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe0a1-3f6a-496c-b1b6-d9fb972c4927 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:50.579850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe0a1-3f6a-496c-b1b6-d9fb972c4927 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:50.580276 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe0a1-3f6a-496c-b1b6-d9fb972c4927 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:50.581045 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fe0a1-3f6a-496c-b1b6-d9fb972c4927 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:50.581427 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fe0a1-3f6a-496c-b1b6-d9fb972c4927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:50.583064 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fe0a1-3f6a-496c-b1b6-d9fb972c4927 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:50.589887 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb608d88-5d12-42f8-a833-e5169b1e64f6 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:50.593640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 175/348] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:50.594670 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fe0a1-3f6a-496c-b1b6-d9fb972c4927 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:50.630789 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1646cb8-d965-4b61-8462-51b827f757ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:50.632187 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1646cb8-d965-4b61-8462-51b827f757ef None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:50.632676 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1646cb8-d965-4b61-8462-51b827f757ef None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:50.633152 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1646cb8-d965-4b61-8462-51b827f757ef None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:50.634097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1646cb8-d965-4b61-8462-51b827f757ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:50.634540 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1646cb8-d965-4b61-8462-51b827f757ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:50.636456 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1646cb8-d965-4b61-8462-51b827f757ef None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:50.647478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 174/349] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:38:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:50.649084 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b8574-469b-4975-af00-22bcf94ad862 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:50.649561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b8574-469b-4975-af00-22bcf94ad862 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:50.650082 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b8574-469b-4975-af00-22bcf94ad862 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:50.651573 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 175/350] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:50.652474 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b8574-469b-4975-af00-22bcf94ad862 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:50.714895 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fe0a1-3f6a-496c-b1b6-d9fb972c4927 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:50.764222 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590e7cb-2b0e-450c-b91e-b2c69b6c3f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:50.765743 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e7cb-2b0e-450c-b91e-b2c69b6c3f9a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:50.766085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e7cb-2b0e-450c-b91e-b2c69b6c3f9a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:50.766356 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e7cb-2b0e-450c-b91e-b2c69b6c3f9a None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:50.767660 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590e7cb-2b0e-450c-b91e-b2c69b6c3f9a None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:50.769159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590e7cb-2b0e-450c-b91e-b2c69b6c3f9a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:50.771112 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 176/351] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:50 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:50.772300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948803c-7071-4f77-896c-7cef383619f2 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:50.772574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948803c-7071-4f77-896c-7cef383619f2 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:50.772839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948803c-7071-4f77-896c-7cef383619f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:50.783586 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b8574-469b-4975-af00-22bcf94ad862 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:50.793884 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-e948803c-7071-4f77-896c-7cef383619f2 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:50.795484 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-e948803c-7071-4f77-896c-7cef383619f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:50.801498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:50.821681 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:50.844824 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2046-6576-4e57-a3e9-f7dff3669aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:50.845178 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2046-6576-4e57-a3e9-f7dff3669aae None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:50.845339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2046-6576-4e57-a3e9-f7dff3669aae None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:50.845601 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2046-6576-4e57-a3e9-f7dff3669aae None admin] PATH_INFO: `/v3/users/8109ba2eb65c4b7ebe5b6ee18ca83442` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:50.846995 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2046-6576-4e57-a3e9-f7dff3669aae None admin] RBAC: Authorizing `identity:get_user(user_id=8109ba2eb65c4b7ebe5b6ee18ca83442)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:50.848937 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2046-6576-4e57-a3e9-f7dff3669aae None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:50.852465 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 176/352] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Aug 19 14:38:50 2022] GET /identity/v3/users/8109ba2eb65c4b7ebe5b6ee18ca83442 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:50.853565 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2046-6576-4e57-a3e9-f7dff3669aae None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:50.901938 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 177/353] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:50.901938 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948803c-7071-4f77-896c-7cef383619f2 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:50.986626 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2046-6576-4e57-a3e9-f7dff3669aae None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:51.028089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48df4c-6263-4d6d-885e-fd2180ab7192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:51.028689 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48df4c-6263-4d6d-885e-fd2180ab7192 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:51.028962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48df4c-6263-4d6d-885e-fd2180ab7192 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:51.029227 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48df4c-6263-4d6d-885e-fd2180ab7192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:51.031698 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948803c-7071-4f77-896c-7cef383619f2 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:51.086675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629222fa-b395-4cfb-92a3-6c9807ff9953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:51.087950 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629222fa-b395-4cfb-92a3-6c9807ff9953 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:51.088285 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629222fa-b395-4cfb-92a3-6c9807ff9953 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:51.088568 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629222fa-b395-4cfb-92a3-6c9807ff9953 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:51.102504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:51.107419 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629222fa-b395-4cfb-92a3-6c9807ff9953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-629222fa-b395-4cfb-92a3-6c9807ff9953 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:51.113778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:51.114756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:51.115563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:51.118452 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 178/354] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:51.120549 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:51.120850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629222fa-b395-4cfb-92a3-6c9807ff9953 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:51.137165 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48df4c-6263-4d6d-885e-fd2180ab7192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:51.138913 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48df4c-6263-4d6d-885e-fd2180ab7192 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:51.249658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629222fa-b395-4cfb-92a3-6c9807ff9953 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:51.283066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 177/355] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:51.284121 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48df4c-6263-4d6d-885e-fd2180ab7192 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:51.287968 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce217b1a-64f2-483b-9ea2-3d0da258a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:51.288912 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce217b1a-64f2-483b-9ea2-3d0da258a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:51.289373 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce217b1a-64f2-483b-9ea2-3d0da258a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:51.289643 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce217b1a-64f2-483b-9ea2-3d0da258a4c1 None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:51.296502 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce217b1a-64f2-483b-9ea2-3d0da258a4c1 None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:51.298033 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce217b1a-64f2-483b-9ea2-3d0da258a4c1 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:51.300023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 179/356] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:38:51 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:51.300804 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce217b1a-64f2-483b-9ea2-3d0da258a4c1 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:51.395372 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:51.413581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:51.426100 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48df4c-6263-4d6d-885e-fd2180ab7192 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:51.454716 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce217b1a-64f2-483b-9ea2-3d0da258a4c1 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:51.471312 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf46455-4871-4aee-858a-52b889311da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:51.471923 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf46455-4871-4aee-858a-52b889311da7 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:51.472195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf46455-4871-4aee-858a-52b889311da7 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:51.473955 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf46455-4871-4aee-858a-52b889311da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:51.474154 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf46455-4871-4aee-858a-52b889311da7 None admin] RBAC: Adding query filter params (role.id=6a16969a32c74a0cb50a64ae9973c938, user.id=8109ba2eb65c4b7ebe5b6ee18ca83442, scope.system=all) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:51.474422 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf46455-4871-4aee-858a-52b889311da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:51.475857 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf46455-4871-4aee-858a-52b889311da7 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:51.490046 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 178/357] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Aug 19 14:38:51 2022] GET /identity/v3/role_assignments?user.id=8109ba2eb65c4b7ebe5b6ee18ca83442&scope.system=all&role.id=6a16969a32c74a0cb50a64ae9973c938 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:51.490046 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf46455-4871-4aee-858a-52b889311da7 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:51.505767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97170056-2413-4295-8598-397ed4dc50e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:51.506918 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97170056-2413-4295-8598-397ed4dc50e8 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:51.507349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97170056-2413-4295-8598-397ed4dc50e8 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:51.507777 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97170056-2413-4295-8598-397ed4dc50e8 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:51.508690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97170056-2413-4295-8598-397ed4dc50e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:51.509175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97170056-2413-4295-8598-397ed4dc50e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:51.511321 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97170056-2413-4295-8598-397ed4dc50e8 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:51.524905 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 180/358] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:51.530826 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97170056-2413-4295-8598-397ed4dc50e8 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:51.636113 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf46455-4871-4aee-858a-52b889311da7 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:51.693309 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97170056-2413-4295-8598-397ed4dc50e8 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:51.694617 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d780063-0fbf-4953-b9d2-65bb05ffbbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:51.695314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780063-0fbf-4953-b9d2-65bb05ffbbe9 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:51.695615 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780063-0fbf-4953-b9d2-65bb05ffbbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:51.696039 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780063-0fbf-4953-b9d2-65bb05ffbbe9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:51.711118 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d780063-0fbf-4953-b9d2-65bb05ffbbe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-0d780063-0fbf-4953-b9d2-65bb05ffbbe9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:51.720155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:51.721274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 179/359] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:38:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:51.722327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d780063-0fbf-4953-b9d2-65bb05ffbbe9 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:51.736980 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:51.752038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:51.754155 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98449e8-d6a7-4a6f-8f80-dbe289ee2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:51.754949 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98449e8-d6a7-4a6f-8f80-dbe289ee2342 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:51.755228 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98449e8-d6a7-4a6f-8f80-dbe289ee2342 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:51.755675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98449e8-d6a7-4a6f-8f80-dbe289ee2342 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:51.757725 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98449e8-d6a7-4a6f-8f80-dbe289ee2342 None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:51.759267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98449e8-d6a7-4a6f-8f80-dbe289ee2342 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:51.761703 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 181/360] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:51 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:51.777123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d65e6-d222-4b8c-a0a7-01606952e739 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:51.777123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d65e6-d222-4b8c-a0a7-01606952e739 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:51.777123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d65e6-d222-4b8c-a0a7-01606952e739 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:51.777123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 182/361] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:51.777123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d65e6-d222-4b8c-a0a7-01606952e739 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:51.892828 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d780063-0fbf-4953-b9d2-65bb05ffbbe9 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:51.920538 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d65e6-d222-4b8c-a0a7-01606952e739 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:51.940256 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61b6e2-8d28-4946-a2a2-8b02d377c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:51.941139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61b6e2-8d28-4946-a2a2-8b02d377c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:51.941564 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61b6e2-8d28-4946-a2a2-8b02d377c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:51.941834 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61b6e2-8d28-4946-a2a2-8b02d377c3c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:51.943968 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61b6e2-8d28-4946-a2a2-8b02d377c3c2 None admin] RBAC: Adding query filter params (group.id=ee4669442c0b4ece96b96987330ef7c5, role.id=d4bd126c45e24b93a90052154a32972b, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:51.943968 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61b6e2-8d28-4946-a2a2-8b02d377c3c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:51.944448 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61b6e2-8d28-4946-a2a2-8b02d377c3c2 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:51.952057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 180/362] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 14:38:51 2022] GET /identity/v3/role_assignments?group.id=ee4669442c0b4ece96b96987330ef7c5&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=d4bd126c45e24b93a90052154a32972b => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:51.953559 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61b6e2-8d28-4946-a2a2-8b02d377c3c2 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:51.959668 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3a1f1-bfe2-47a1-a1d2-229c52ccda82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:51.960296 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a1f1-bfe2-47a1-a1d2-229c52ccda82 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:51.960569 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a1f1-bfe2-47a1-a1d2-229c52ccda82 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:51.960834 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a1f1-bfe2-47a1-a1d2-229c52ccda82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:52.058489 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:52.070290 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3a1f1-bfe2-47a1-a1d2-229c52ccda82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:52.071835 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3a1f1-bfe2-47a1-a1d2-229c52ccda82 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:52.098286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:52.133486 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61b6e2-8d28-4946-a2a2-8b02d377c3c2 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:52.180929 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb94aa5-984d-49a9-af72-8c8a14bc744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:52.181480 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb94aa5-984d-49a9-af72-8c8a14bc744c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:52.182015 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb94aa5-984d-49a9-af72-8c8a14bc744c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:52.182303 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb94aa5-984d-49a9-af72-8c8a14bc744c None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:52.182996 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb94aa5-984d-49a9-af72-8c8a14bc744c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:52.183299 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb94aa5-984d-49a9-af72-8c8a14bc744c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:52.185616 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb94aa5-984d-49a9-af72-8c8a14bc744c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:52.199335 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 181/363] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:38:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:52.199335 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb94aa5-984d-49a9-af72-8c8a14bc744c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:52.218292 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 183/364] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:52.219824 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc723-ca5e-4ea1-956e-a041b61515ad None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:52.220110 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc723-ca5e-4ea1-956e-a041b61515ad None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:52.220383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc723-ca5e-4ea1-956e-a041b61515ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:52.247673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-2a0dc723-ca5e-4ea1-956e-a041b61515ad None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:52.249241 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-2a0dc723-ca5e-4ea1-956e-a041b61515ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:52.332408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 184/365] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:52.335476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb94aa5-984d-49a9-af72-8c8a14bc744c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:52.342840 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc723-ca5e-4ea1-956e-a041b61515ad None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:52.381346 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da113c8-a9e0-4a51-83d3-c87edb917fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:52.382037 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da113c8-a9e0-4a51-83d3-c87edb917fc1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:52.382320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da113c8-a9e0-4a51-83d3-c87edb917fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:52.382591 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da113c8-a9e0-4a51-83d3-c87edb917fc1 None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:52.384037 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da113c8-a9e0-4a51-83d3-c87edb917fc1 None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:52.385709 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da113c8-a9e0-4a51-83d3-c87edb917fc1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:52.386748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:52.388109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 182/366] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:38:52 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:52.389527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da113c8-a9e0-4a51-83d3-c87edb917fc1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:52.398666 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:52.475969 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc723-ca5e-4ea1-956e-a041b61515ad None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:52.513332 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef1469-f4ee-403a-b714-667d2e89df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:52.513982 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef1469-f4ee-403a-b714-667d2e89df51 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:52.514256 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef1469-f4ee-403a-b714-667d2e89df51 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:52.514531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef1469-f4ee-403a-b714-667d2e89df51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:52.515497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da113c8-a9e0-4a51-83d3-c87edb917fc1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:52.554923 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c79e-4ff4-4539-ac78-53943116f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:52.555575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c79e-4ff4-4539-ac78-53943116f5a2 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:52.555853 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c79e-4ff4-4539-ac78-53943116f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:52.556184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c79e-4ff4-4539-ac78-53943116f5a2 None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:52.557788 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c79e-4ff4-4539-ac78-53943116f5a2 None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:52.559631 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c79e-4ff4-4539-ac78-53943116f5a2 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:52.562046 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 183/367] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:52 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:52.562920 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c79e-4ff4-4539-ac78-53943116f5a2 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:52.595927 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef1469-f4ee-403a-b714-667d2e89df51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:52.597415 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef1469-f4ee-403a-b714-667d2e89df51 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:52.623815 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:52.651148 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:52.690089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c79e-4ff4-4539-ac78-53943116f5a2 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:52.715081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 185/368] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:52.715969 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef1469-f4ee-403a-b714-667d2e89df51 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:52.734423 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3698-81f5-4305-973b-333898aa01b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:52.735136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3698-81f5-4305-973b-333898aa01b2 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:52.735423 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3698-81f5-4305-973b-333898aa01b2 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:52.735701 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3698-81f5-4305-973b-333898aa01b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:52.736446 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf3698-81f5-4305-973b-333898aa01b2 None admin] RBAC: Adding query filter params (group.id=ee4669442c0b4ece96b96987330ef7c5, role.id=d3126a0397e243eeb3aa834efbabf407, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:52.736761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf3698-81f5-4305-973b-333898aa01b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:52.738693 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf3698-81f5-4305-973b-333898aa01b2 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:52.747122 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 184/369] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 14:38:52 2022] GET /identity/v3/role_assignments?group.id=ee4669442c0b4ece96b96987330ef7c5&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=d3126a0397e243eeb3aa834efbabf407 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:52.748115 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3698-81f5-4305-973b-333898aa01b2 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:52.901454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef1469-f4ee-403a-b714-667d2e89df51 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:52.916591 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3698-81f5-4305-973b-333898aa01b2 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:52.942296 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:52.959177 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52f9c-1429-4b6e-bd56-43e4594c4415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:52.960566 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52f9c-1429-4b6e-bd56-43e4594c4415 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:52.960839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52f9c-1429-4b6e-bd56-43e4594c4415 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:52.961106 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52f9c-1429-4b6e-bd56-43e4594c4415 None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:52.962619 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f52f9c-1429-4b6e-bd56-43e4594c4415 None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:52.965022 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f52f9c-1429-4b6e-bd56-43e4594c4415 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:52.967180 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 186/370] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:38:52 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:52.968114 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52f9c-1429-4b6e-bd56-43e4594c4415 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:52.978656 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8407db-1851-4822-9e0b-46afb48c083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:52.979327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8407db-1851-4822-9e0b-46afb48c083a None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:52.979607 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8407db-1851-4822-9e0b-46afb48c083a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:52.979884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8407db-1851-4822-9e0b-46afb48c083a None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:52.981096 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8407db-1851-4822-9e0b-46afb48c083a None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:52.982626 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8407db-1851-4822-9e0b-46afb48c083a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:52.986867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 185/371] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:52 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:52.987654 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8407db-1851-4822-9e0b-46afb48c083a None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:52.997217 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:53.110345 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52f9c-1429-4b6e-bd56-43e4594c4415 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:53.141326 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8407db-1851-4822-9e0b-46afb48c083a None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:53.155996 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456f157-982f-4290-94a0-f58aaa9b6116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:53.157037 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456f157-982f-4290-94a0-f58aaa9b6116 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:53.157524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456f157-982f-4290-94a0-f58aaa9b6116 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:53.157982 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456f157-982f-4290-94a0-f58aaa9b6116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:53.170689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456f157-982f-4290-94a0-f58aaa9b6116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-c456f157-982f-4290-94a0-f58aaa9b6116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:53.176227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:53.177094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:53.177874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:53.183784 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 187/372] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:38:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:53.183784 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456f157-982f-4290-94a0-f58aaa9b6116 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:53.190767 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1d41b-1552-48a1-9d15-ec322af5cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:53.191400 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1d41b-1552-48a1-9d15-ec322af5cb9b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:53.191678 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1d41b-1552-48a1-9d15-ec322af5cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:53.191946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1d41b-1552-48a1-9d15-ec322af5cb9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:53.192690 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1d41b-1552-48a1-9d15-ec322af5cb9b None admin] RBAC: Adding query filter params (group.id=ee4669442c0b4ece96b96987330ef7c5, role.id=d4bd126c45e24b93a90052154a32972b, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:53.192999 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1d41b-1552-48a1-9d15-ec322af5cb9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:53.195665 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1d41b-1552-48a1-9d15-ec322af5cb9b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:53.203018 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 186/373] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 14:38:52 2022] GET /identity/v3/role_assignments?group.id=ee4669442c0b4ece96b96987330ef7c5&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=d4bd126c45e24b93a90052154a32972b => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:53.204395 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1d41b-1552-48a1-9d15-ec322af5cb9b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:53.277423 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:53.297447 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:53.355062 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456f157-982f-4290-94a0-f58aaa9b6116 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:53.399657 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845658-c6e4-412c-b16f-ce28bbdfbc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:53.400875 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845658-c6e4-412c-b16f-ce28bbdfbc2e None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:53.401180 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845658-c6e4-412c-b16f-ce28bbdfbc2e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:53.401602 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845658-c6e4-412c-b16f-ce28bbdfbc2e None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:53.403460 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1845658-c6e4-412c-b16f-ce28bbdfbc2e None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:53.405101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1845658-c6e4-412c-b16f-ce28bbdfbc2e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:53.407272 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 188/374] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:38:53 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:53.409307 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1d41b-1552-48a1-9d15-ec322af5cb9b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:53.415048 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845658-c6e4-412c-b16f-ce28bbdfbc2e None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:53.478796 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd995d5-8aa5-4560-96e0-3f449761e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:53.479487 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd995d5-8aa5-4560-96e0-3f449761e98c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:53.479811 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd995d5-8aa5-4560-96e0-3f449761e98c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:53.480177 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd995d5-8aa5-4560-96e0-3f449761e98c None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:53.480845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd995d5-8aa5-4560-96e0-3f449761e98c None admin] RBAC: Adding query filter params (name=admin) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:53.481218 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd995d5-8aa5-4560-96e0-3f449761e98c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:53.482961 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd995d5-8aa5-4560-96e0-3f449761e98c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:53.495144 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 187/375] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:53.500723 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd995d5-8aa5-4560-96e0-3f449761e98c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:53.602792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845658-c6e4-412c-b16f-ce28bbdfbc2e None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:53.632604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:53.652615 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe5689-0db8-4eb0-b054-89b13b0824d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:53.653265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe5689-0db8-4eb0-b054-89b13b0824d5 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:53.653535 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe5689-0db8-4eb0-b054-89b13b0824d5 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:53.653792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe5689-0db8-4eb0-b054-89b13b0824d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:53.654593 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe5689-0db8-4eb0-b054-89b13b0824d5 None admin] RBAC: Adding query filter params (group.id=ee4669442c0b4ece96b96987330ef7c5, role.id=d3126a0397e243eeb3aa834efbabf407, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:53.654897 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe5689-0db8-4eb0-b054-89b13b0824d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:53.656332 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe5689-0db8-4eb0-b054-89b13b0824d5 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:53.664134 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 189/376] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 14:38:53 2022] GET /identity/v3/role_assignments?group.id=ee4669442c0b4ece96b96987330ef7c5&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=d3126a0397e243eeb3aa834efbabf407 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:53.668227 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd995d5-8aa5-4560-96e0-3f449761e98c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:53.710563 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:53.711640 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc30356-02ae-40c8-9c3b-ff0373ce5063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:53.712178 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30356-02ae-40c8-9c3b-ff0373ce5063 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:53.712475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30356-02ae-40c8-9c3b-ff0373ce5063 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:53.713182 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30356-02ae-40c8-9c3b-ff0373ce5063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:53.800672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc30356-02ae-40c8-9c3b-ff0373ce5063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:53.802193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc30356-02ae-40c8-9c3b-ff0373ce5063 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:53.937636 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 188/377] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:38:53.943663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe5689-0db8-4eb0-b054-89b13b0824d5 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:54.079809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe5689-0db8-4eb0-b054-89b13b0824d5 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:54.125475 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461d48f-99b5-4365-85db-735bc4b1b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:54.126147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461d48f-99b5-4365-85db-735bc4b1b303 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:54.126421 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461d48f-99b5-4365-85db-735bc4b1b303 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:54.126688 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461d48f-99b5-4365-85db-735bc4b1b303 None admin] PATH_INFO: `/v3/projects/c5667f138f3a41d2b41486682bb7771c` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:54.130618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461d48f-99b5-4365-85db-735bc4b1b303 None admin] RBAC: Authorizing `identity:get_project(project_id=c5667f138f3a41d2b41486682bb7771c)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:54.132083 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461d48f-99b5-4365-85db-735bc4b1b303 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:54.134333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 190/378] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:53 2022] GET /identity/v3/projects/c5667f138f3a41d2b41486682bb7771c => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:54.142595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc30356-02ae-40c8-9c3b-ff0373ce5063 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:54.191038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:54.275054 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc30356-02ae-40c8-9c3b-ff0373ce5063 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:54.329853 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b8b95-3ecc-4e9b-88c4-ba4f220d8ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:54.330550 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8b95-3ecc-4e9b-88c4-ba4f220d8ab1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:54.330825 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8b95-3ecc-4e9b-88c4-ba4f220d8ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:54.331093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8b95-3ecc-4e9b-88c4-ba4f220d8ab1 None admin] PATH_INFO: `/v3/groups/679ae63fca8c46bebc6c19a396b7b759` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:54.339495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b8b95-3ecc-4e9b-88c4-ba4f220d8ab1 None admin] RBAC: Authorizing `identity:get_group(group_id=679ae63fca8c46bebc6c19a396b7b759)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:54.341068 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b8b95-3ecc-4e9b-88c4-ba4f220d8ab1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:54.343138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 189/379] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:38:54 2022] GET /identity/v3/groups/679ae63fca8c46bebc6c19a396b7b759 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:54.349431 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461d48f-99b5-4365-85db-735bc4b1b303 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:54.461964 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:54.567250 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461d48f-99b5-4365-85db-735bc4b1b303 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:54.624355 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1806ed-064d-499f-8055-1e5a075e4088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:54.624978 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1806ed-064d-499f-8055-1e5a075e4088 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:54.625257 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1806ed-064d-499f-8055-1e5a075e4088 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:54.625526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1806ed-064d-499f-8055-1e5a075e4088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:54.626293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1806ed-064d-499f-8055-1e5a075e4088 None admin] RBAC: Adding query filter params (group.id=679ae63fca8c46bebc6c19a396b7b759, role.id=d444334199c640a7af820f46e283d49d, scope.project.id=c5667f138f3a41d2b41486682bb7771c) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:54.626604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1806ed-064d-499f-8055-1e5a075e4088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:54.628054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1806ed-064d-499f-8055-1e5a075e4088 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:54.640975 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 191/380] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 14:38:54 2022] GET /identity/v3/role_assignments?group.id=679ae63fca8c46bebc6c19a396b7b759&scope.project.id=c5667f138f3a41d2b41486682bb7771c&role.id=d444334199c640a7af820f46e283d49d => generated 260 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:54.947891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5add-c4e1-4b0b-a60a-5f40757a5d6e None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:54.948482 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5add-c4e1-4b0b-a60a-5f40757a5d6e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:54.948565 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5add-c4e1-4b0b-a60a-5f40757a5d6e None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:54.950281 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 190/381] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:54.958213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c8933-63e3-40cd-9f0a-8cbd84e2bf1a None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:54.958711 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c8933-63e3-40cd-9f0a-8cbd84e2bf1a None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:54.958814 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c8933-63e3-40cd-9f0a-8cbd84e2bf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:54.983006 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-5c4c8933-63e3-40cd-9f0a-8cbd84e2bf1a None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:54.985627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-5c4c8933-63e3-40cd-9f0a-8cbd84e2bf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:55.110040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 192/382] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:55.745311 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c5add-c4e1-4b0b-a60a-5f40757a5d6e None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:55.847804 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48a898-4eaf-4108-9eef-e3527d22ec8e None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:55.848463 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48a898-4eaf-4108-9eef-e3527d22ec8e None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:55.848930 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48a898-4eaf-4108-9eef-e3527d22ec8e None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:55.851930 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 193/383] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:55.856808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda06a4-e8e6-4027-b937-f9bf99440e35 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:55.857316 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda06a4-e8e6-4027-b937-f9bf99440e35 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:55.857776 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda06a4-e8e6-4027-b937-f9bf99440e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:55.886289 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:55.888723 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-1eda06a4-e8e6-4027-b937-f9bf99440e35 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:55.890580 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-1eda06a4-e8e6-4027-b937-f9bf99440e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:55.895452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c5add-c4e1-4b0b-a60a-5f40757a5d6e None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:55.957166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c0de7-dd12-4d7f-bd5c-77fb2729e6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:55.958099 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c0de7-dd12-4d7f-bd5c-77fb2729e6de None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:55.958384 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c0de7-dd12-4d7f-bd5c-77fb2729e6de None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:55.958654 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c0de7-dd12-4d7f-bd5c-77fb2729e6de None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:55.978287 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:55.983732 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c0de7-dd12-4d7f-bd5c-77fb2729e6de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-588c0de7-dd12-4d7f-bd5c-77fb2729e6de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:55.988741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:55.989703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:55.990514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:55.991312 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 191/384] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:55.999125 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c0de7-dd12-4d7f-bd5c-77fb2729e6de None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:56.034155 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 194/385] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:38:56.141568 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c0de7-dd12-4d7f-bd5c-77fb2729e6de None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:56.184057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d68f0-9b68-467b-8306-de9d3695ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:56.184734 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d68f0-9b68-467b-8306-de9d3695ee3c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:56.185020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d68f0-9b68-467b-8306-de9d3695ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:56.185291 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d68f0-9b68-467b-8306-de9d3695ee3c None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:56.185981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d68f0-9b68-467b-8306-de9d3695ee3c None admin] RBAC: Adding query filter params (name=member) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:56.186286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d68f0-9b68-467b-8306-de9d3695ee3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:56.187699 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d68f0-9b68-467b-8306-de9d3695ee3c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:56.197599 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 192/386] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:56.204156 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda06a4-e8e6-4027-b937-f9bf99440e35 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:56.281847 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44967aaf-70df-4f50-8290-7d755e2ff76d None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:56.282199 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44967aaf-70df-4f50-8290-7d755e2ff76d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:56.282432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44967aaf-70df-4f50-8290-7d755e2ff76d None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:56.284154 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 193/387] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:56.296579 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8b0f2-761f-4c0a-8b25-541f90845768 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:56.297174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8b0f2-761f-4c0a-8b25-541f90845768 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:56.297653 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8b0f2-761f-4c0a-8b25-541f90845768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:56.324768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-ecf8b0f2-761f-4c0a-8b25-541f90845768 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:56.326108 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-ecf8b0f2-761f-4c0a-8b25-541f90845768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:56.332715 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda06a4-e8e6-4027-b937-f9bf99440e35 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:56.342504 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:56.372709 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b68d88-d6e3-49d2-bb06-05f82f9d23b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:56.373513 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b68d88-d6e3-49d2-bb06-05f82f9d23b2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:56.373846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b68d88-d6e3-49d2-bb06-05f82f9d23b2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:56.374207 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b68d88-d6e3-49d2-bb06-05f82f9d23b2 None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:56.375439 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b68d88-d6e3-49d2-bb06-05f82f9d23b2 None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:56.377074 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b68d88-d6e3-49d2-bb06-05f82f9d23b2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:56.383454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 195/388] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:38:56 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:56.385164 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe07338-38bf-47fa-be30-a34da2191bc9 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:56.385534 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe07338-38bf-47fa-be30-a34da2191bc9 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:56.386291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe07338-38bf-47fa-be30-a34da2191bc9 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:56.387900 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 196/389] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:56.388717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe07338-38bf-47fa-be30-a34da2191bc9 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:56.410602 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 194/390] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:56.412356 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a2e89-551d-4357-aa5f-fbc3550eb5e4 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:56.412815 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a2e89-551d-4357-aa5f-fbc3550eb5e4 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:56.413252 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a2e89-551d-4357-aa5f-fbc3550eb5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:56.433224 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-d95a2e89-551d-4357-aa5f-fbc3550eb5e4 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:56.434935 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-d95a2e89-551d-4357-aa5f-fbc3550eb5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:56.438400 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:56.506643 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe07338-38bf-47fa-be30-a34da2191bc9 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:56.518304 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 195/391] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:56.519893 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a2e89-551d-4357-aa5f-fbc3550eb5e4 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:56.570328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4417cb-f62c-49cd-92b5-df73febd26fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:56.570935 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4417cb-f62c-49cd-92b5-df73febd26fe None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:56.571281 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4417cb-f62c-49cd-92b5-df73febd26fe None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:56.571639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4417cb-f62c-49cd-92b5-df73febd26fe None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:56.572957 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4417cb-f62c-49cd-92b5-df73febd26fe None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:56.574581 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4417cb-f62c-49cd-92b5-df73febd26fe None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:56.583987 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 197/392] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:56 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:38:56.590276 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4417cb-f62c-49cd-92b5-df73febd26fe None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:56.609558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:56.654147 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a2e89-551d-4357-aa5f-fbc3550eb5e4 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:56.692539 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155540c-f29d-4487-ba93-db2b633c780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:56.693550 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155540c-f29d-4487-ba93-db2b633c780f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:56.694068 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155540c-f29d-4487-ba93-db2b633c780f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:56.694531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155540c-f29d-4487-ba93-db2b633c780f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:56.706164 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155540c-f29d-4487-ba93-db2b633c780f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-7155540c-f29d-4487-ba93-db2b633c780f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:56.711557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:56.712438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:56.713358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:56.716088 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 196/393] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:56.727293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155540c-f29d-4487-ba93-db2b633c780f None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:56.764929 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4417cb-f62c-49cd-92b5-df73febd26fe None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:56.788809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:56.817484 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d6bd0-c50b-45e0-afe7-59edbe25424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:56.818207 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d6bd0-c50b-45e0-afe7-59edbe25424f None admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:56.818446 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d6bd0-c50b-45e0-afe7-59edbe25424f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:56.818714 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d6bd0-c50b-45e0-afe7-59edbe25424f None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/groups/ee4669442c0b4ece96b96987330ef7c5/roles/d4bd126c45e24b93a90052154a32972b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:56.820680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d6bd0-c50b-45e0-afe7-59edbe25424f None admin] RBAC: Authorizing `identity:create_grant(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b, group_id=ee4669442c0b4ece96b96987330ef7c5, role_id=d4bd126c45e24b93a90052154a32972b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:56.822173 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d6bd0-c50b-45e0-afe7-59edbe25424f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:56.837310 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 198/394] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Aug 19 14:38:56 2022] PUT /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/groups/ee4669442c0b4ece96b96987330ef7c5/roles/d4bd126c45e24b93a90052154a32972b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 14:38:56.838922 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d6bd0-c50b-45e0-afe7-59edbe25424f None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:56.843765 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155540c-f29d-4487-ba93-db2b633c780f None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:56.890866 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7801-57d1-41e6-9454-1ea593593ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:56.892020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7801-57d1-41e6-9454-1ea593593ba1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:56.892498 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7801-57d1-41e6-9454-1ea593593ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:56.892991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7801-57d1-41e6-9454-1ea593593ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:56.894109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b7801-57d1-41e6-9454-1ea593593ba1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:56.894658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b7801-57d1-41e6-9454-1ea593593ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:56.896422 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b7801-57d1-41e6-9454-1ea593593ba1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:56.900237 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:56.908222 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 197/395] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:38:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:56.909399 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7801-57d1-41e6-9454-1ea593593ba1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:56.976201 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d6bd0-c50b-45e0-afe7-59edbe25424f None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:57.020100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1842b3-05cf-408b-804c-f338f7cf7fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:57.020800 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1842b3-05cf-408b-804c-f338f7cf7fb2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.021115 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1842b3-05cf-408b-804c-f338f7cf7fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.021411 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1842b3-05cf-408b-804c-f338f7cf7fb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.033743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7801-57d1-41e6-9454-1ea593593ba1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:57.036182 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1842b3-05cf-408b-804c-f338f7cf7fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-ee1842b3-05cf-408b-804c-f338f7cf7fb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:57.042473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:57.043417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:38:57.044216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:38:57.044939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 199/396] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:57.046296 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1842b3-05cf-408b-804c-f338f7cf7fb2 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:57.078204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1db37-d17c-4a36-9413-51f52531a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:57.078856 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1db37-d17c-4a36-9413-51f52531a64c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.079132 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1db37-d17c-4a36-9413-51f52531a64c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.079403 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1db37-d17c-4a36-9413-51f52531a64c None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.093520 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:57.100041 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1db37-d17c-4a36-9413-51f52531a64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-9eb1db37-d17c-4a36-9413-51f52531a64c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:57.106179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:57.107076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:57.107855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 198/397] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:57.108508 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1db37-d17c-4a36-9413-51f52531a64c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:57.176775 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:57.198109 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1842b3-05cf-408b-804c-f338f7cf7fb2 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:57.234614 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1db37-d17c-4a36-9413-51f52531a64c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:57.234809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b52c-1161-442a-bc5d-a9b68833f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:57.235261 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b52c-1161-442a-bc5d-a9b68833f4b7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.235532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b52c-1161-442a-bc5d-a9b68833f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.235798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b52c-1161-442a-bc5d-a9b68833f4b7 None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.236947 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5b52c-1161-442a-bc5d-a9b68833f4b7 None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:57.238444 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5b52c-1161-442a-bc5d-a9b68833f4b7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:57.240200 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 200/398] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:38:57 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:57.240792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b52c-1161-442a-bc5d-a9b68833f4b7 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:57.280609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e097469-4a28-42c8-a6d6-3dcc46721a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:57.281492 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097469-4a28-42c8-a6d6-3dcc46721a2d None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.281772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097469-4a28-42c8-a6d6-3dcc46721a2d None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.282104 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097469-4a28-42c8-a6d6-3dcc46721a2d None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.283725 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e097469-4a28-42c8-a6d6-3dcc46721a2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:57.284057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e097469-4a28-42c8-a6d6-3dcc46721a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:57.285524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e097469-4a28-42c8-a6d6-3dcc46721a2d None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:57.298189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 199/399] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:38:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:57.299474 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e097469-4a28-42c8-a6d6-3dcc46721a2d None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:57.383908 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:57.386415 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b52c-1161-442a-bc5d-a9b68833f4b7 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:57.428967 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dae0f-d99e-4042-958c-c22bb5037d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:57.430245 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dae0f-d99e-4042-958c-c22bb5037d1f None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.430732 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dae0f-d99e-4042-958c-c22bb5037d1f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.431422 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dae0f-d99e-4042-958c-c22bb5037d1f None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.433416 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4dae0f-d99e-4042-958c-c22bb5037d1f None admin] RBAC: Adding query filter params (name=member) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:57.434068 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4dae0f-d99e-4042-958c-c22bb5037d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:57.436277 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4dae0f-d99e-4042-958c-c22bb5037d1f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:57.442380 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e097469-4a28-42c8-a6d6-3dcc46721a2d None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:57.450139 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 201/400] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:38:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:57.452135 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dae0f-d99e-4042-958c-c22bb5037d1f None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:57.469534 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:57.493269 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec58e1e-8c6e-40e0-acd8-5d52f014a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:57.494400 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec58e1e-8c6e-40e0-acd8-5d52f014a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.494817 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec58e1e-8c6e-40e0-acd8-5d52f014a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.495246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec58e1e-8c6e-40e0-acd8-5d52f014a4a0 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.497687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec58e1e-8c6e-40e0-acd8-5d52f014a4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:57.499610 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec58e1e-8c6e-40e0-acd8-5d52f014a4a0 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:57.501411 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 200/401] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:57 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:57.503002 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec58e1e-8c6e-40e0-acd8-5d52f014a4a0 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:57.569569 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dae0f-d99e-4042-958c-c22bb5037d1f None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:57.606806 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf6ddc-38b5-4ee0-bb86-27051bbbd4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:57.607693 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf6ddc-38b5-4ee0-bb86-27051bbbd4b4 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.608079 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf6ddc-38b5-4ee0-bb86-27051bbbd4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.608447 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf6ddc-38b5-4ee0-bb86-27051bbbd4b4 None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.609707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf6ddc-38b5-4ee0-bb86-27051bbbd4b4 None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:57.611312 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf6ddc-38b5-4ee0-bb86-27051bbbd4b4 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:57.613163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 202/402] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:38:57 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:57.614050 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf6ddc-38b5-4ee0-bb86-27051bbbd4b4 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:57.648334 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:57.651325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec58e1e-8c6e-40e0-acd8-5d52f014a4a0 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:57.707995 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b399-5d91-4996-8963-14ec2f340c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:57.708911 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b399-5d91-4996-8963-14ec2f340c4c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.709321 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b399-5d91-4996-8963-14ec2f340c4c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.710289 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b399-5d91-4996-8963-14ec2f340c4c None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.713133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b399-5d91-4996-8963-14ec2f340c4c None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:57.714702 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b399-5d91-4996-8963-14ec2f340c4c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:57.721590 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 201/403] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:38:57 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:57.722631 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b399-5d91-4996-8963-14ec2f340c4c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:57.741995 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf6ddc-38b5-4ee0-bb86-27051bbbd4b4 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:57.784044 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:57.793850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e908349-5d45-4104-89cd-9cb3a770a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:57.795018 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e908349-5d45-4104-89cd-9cb3a770a273 None admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.795657 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e908349-5d45-4104-89cd-9cb3a770a273 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.796094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e908349-5d45-4104-89cd-9cb3a770a273 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/groups/ee4669442c0b4ece96b96987330ef7c5/roles/d3126a0397e243eeb3aa834efbabf407` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.799537 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e908349-5d45-4104-89cd-9cb3a770a273 None admin] RBAC: Authorizing `identity:create_grant(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b, group_id=ee4669442c0b4ece96b96987330ef7c5, role_id=d3126a0397e243eeb3aa834efbabf407)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:57.802402 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e908349-5d45-4104-89cd-9cb3a770a273 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:57.823211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 203/404] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Aug 19 14:38:57 2022] PUT /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b/groups/ee4669442c0b4ece96b96987330ef7c5/roles/d3126a0397e243eeb3aa834efbabf407 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:57.824327 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e908349-5d45-4104-89cd-9cb3a770a273 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:57.839107 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b399-5d91-4996-8963-14ec2f340c4c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:57.897779 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdb2a6-1659-47d7-9aa6-1984c4b3bfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:57.899329 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdb2a6-1659-47d7-9aa6-1984c4b3bfef None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.900146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdb2a6-1659-47d7-9aa6-1984c4b3bfef None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.900780 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdb2a6-1659-47d7-9aa6-1984c4b3bfef None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.903090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdb2a6-1659-47d7-9aa6-1984c4b3bfef None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:57.905708 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdb2a6-1659-47d7-9aa6-1984c4b3bfef None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:57.908543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 202/405] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:57 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:57.910787 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563abb5-8d96-4a10-bd89-bfaf74ab806e None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:57.911204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563abb5-8d96-4a10-bd89-bfaf74ab806e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:57.911607 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563abb5-8d96-4a10-bd89-bfaf74ab806e None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:57.913265 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 203/406] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:38:57.914542 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563abb5-8d96-4a10-bd89-bfaf74ab806e None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:57.947645 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:57.963053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e908349-5d45-4104-89cd-9cb3a770a273 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:58.007662 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beaba86-8be8-4f2e-b1ec-3a5157d4497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:58.008830 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaba86-8be8-4f2e-b1ec-3a5157d4497c None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:58.009225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaba86-8be8-4f2e-b1ec-3a5157d4497c None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:58.009682 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaba86-8be8-4f2e-b1ec-3a5157d4497c None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:58.011576 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beaba86-8be8-4f2e-b1ec-3a5157d4497c None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:58.014283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beaba86-8be8-4f2e-b1ec-3a5157d4497c None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:58.018009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 204/407] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:57 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:58.019788 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b902-e186-414b-8685-b3b74d171f2f None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:58.020272 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b902-e186-414b-8685-b3b74d171f2f None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:58.021130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b902-e186-414b-8685-b3b74d171f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:58.053389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-a8e3b902-e186-414b-8685-b3b74d171f2f None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:58.054849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-a8e3b902-e186-414b-8685-b3b74d171f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:58.078252 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563abb5-8d96-4a10-bd89-bfaf74ab806e None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:58.118267 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:58.142646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad9fdf-4435-417c-ab2b-b123b3674e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:58.143332 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad9fdf-4435-417c-ab2b-b123b3674e0a None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:58.143609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad9fdf-4435-417c-ab2b-b123b3674e0a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:58.143877 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad9fdf-4435-417c-ab2b-b123b3674e0a None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/groups/ee4669442c0b4ece96b96987330ef7c5/roles/d3126a0397e243eeb3aa834efbabf407` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:58.144452 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 205/408] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:38:58.145051 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b902-e186-414b-8685-b3b74d171f2f None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:58.148942 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad9fdf-4435-417c-ab2b-b123b3674e0a None admin] RBAC: Authorizing `identity:create_grant(project_id=3a551dfadb7041dd8a9c66dc25bc02a1, group_id=ee4669442c0b4ece96b96987330ef7c5, role_id=d3126a0397e243eeb3aa834efbabf407)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:58.151082 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad9fdf-4435-417c-ab2b-b123b3674e0a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:58.172036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 204/409] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Aug 19 14:38:57 2022] PUT /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/groups/ee4669442c0b4ece96b96987330ef7c5/roles/d3126a0397e243eeb3aa834efbabf407 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:58.264923 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:58.277579 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b902-e186-414b-8685-b3b74d171f2f None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:58.315813 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d080053-3c3e-4b7a-a99e-640be3b172af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:58.316514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d080053-3c3e-4b7a-a99e-640be3b172af None admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:58.316785 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d080053-3c3e-4b7a-a99e-640be3b172af None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:58.317062 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d080053-3c3e-4b7a-a99e-640be3b172af None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/groups/ee4669442c0b4ece96b96987330ef7c5/roles/d4bd126c45e24b93a90052154a32972b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:58.323935 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d080053-3c3e-4b7a-a99e-640be3b172af None admin] RBAC: Authorizing `identity:create_grant(project_id=3a551dfadb7041dd8a9c66dc25bc02a1, group_id=ee4669442c0b4ece96b96987330ef7c5, role_id=d4bd126c45e24b93a90052154a32972b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:58.325428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d080053-3c3e-4b7a-a99e-640be3b172af None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:58.346710 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 206/410] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Aug 19 14:38:58 2022] PUT /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1/groups/ee4669442c0b4ece96b96987330ef7c5/roles/d4bd126c45e24b93a90052154a32972b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:58.563642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad9fdf-4435-417c-ab2b-b123b3674e0a None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:58.685309 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad9fdf-4435-417c-ab2b-b123b3674e0a None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:58.723506 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6b94-654b-4a5a-9fde-fbe61d9f15a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:58.724505 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6b94-654b-4a5a-9fde-fbe61d9f15a9 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:58.725054 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6b94-654b-4a5a-9fde-fbe61d9f15a9 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:58.725625 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6b94-654b-4a5a-9fde-fbe61d9f15a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:58.739327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b6b94-654b-4a5a-9fde-fbe61d9f15a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-066b6b94-654b-4a5a-9fde-fbe61d9f15a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:38:58.745091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:38:58.746055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:38:58.746900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:38:58.750232 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 205/411] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:38:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:38:58.756166 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d080053-3c3e-4b7a-a99e-640be3b172af None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:58.910030 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d080053-3c3e-4b7a-a99e-640be3b172af None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:58.958388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c82f85-f919-4f34-9a12-74345c21962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:58.959361 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c82f85-f919-4f34-9a12-74345c21962e None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:58.959851 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c82f85-f919-4f34-9a12-74345c21962e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:58.960377 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c82f85-f919-4f34-9a12-74345c21962e None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:58.961547 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c82f85-f919-4f34-9a12-74345c21962e None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:38:58.962138 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c82f85-f919-4f34-9a12-74345c21962e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:58.963980 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c82f85-f919-4f34-9a12-74345c21962e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:58.977601 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 207/412] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:58.983381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6b94-654b-4a5a-9fde-fbe61d9f15a9 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:59.034976 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:59.116609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6b94-654b-4a5a-9fde-fbe61d9f15a9 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:59.152982 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e4517-f8c3-46fa-a49d-ec853bb95e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:59.153627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e4517-f8c3-46fa-a49d-ec853bb95e00 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:59.153898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e4517-f8c3-46fa-a49d-ec853bb95e00 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:59.154215 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e4517-f8c3-46fa-a49d-ec853bb95e00 None admin] PATH_INFO: `/v3/groups/679ae63fca8c46bebc6c19a396b7b759` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:59.155297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e4517-f8c3-46fa-a49d-ec853bb95e00 None admin] RBAC: Authorizing `identity:get_group(group_id=679ae63fca8c46bebc6c19a396b7b759)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:59.156970 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e4517-f8c3-46fa-a49d-ec853bb95e00 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:59.158558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 206/413] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:38:58 2022] GET /identity/v3/groups/679ae63fca8c46bebc6c19a396b7b759 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:59.164535 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c82f85-f919-4f34-9a12-74345c21962e None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:59.180622 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:59.307737 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c82f85-f919-4f34-9a12-74345c21962e None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:59.353773 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fbf5b-b63f-4758-9465-9bce42c0d4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:59.354437 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbf5b-b63f-4758-9465-9bce42c0d4dc None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:59.354707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbf5b-b63f-4758-9465-9bce42c0d4dc None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:59.354970 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbf5b-b63f-4758-9465-9bce42c0d4dc None admin] PATH_INFO: `/v3/projects/c5667f138f3a41d2b41486682bb7771c` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:59.356092 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fbf5b-b63f-4758-9465-9bce42c0d4dc None admin] RBAC: Authorizing `identity:get_project(project_id=c5667f138f3a41d2b41486682bb7771c)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:59.357599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fbf5b-b63f-4758-9465-9bce42c0d4dc None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:59.359428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 208/414] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:38:59 2022] GET /identity/v3/projects/c5667f138f3a41d2b41486682bb7771c => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:38:59.368552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e4517-f8c3-46fa-a49d-ec853bb95e00 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:38:59.472450 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f022bb-d214-480f-9a40-d4706c23cc0f None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:59.472643 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f022bb-d214-480f-9a40-d4706c23cc0f None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:59.472894 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f022bb-d214-480f-9a40-d4706c23cc0f None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:59.474571 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 209/415] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:38:59.482021 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488995b-db40-4bd3-a506-86481e748b27 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:59.482368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488995b-db40-4bd3-a506-86481e748b27 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:59.482560 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488995b-db40-4bd3-a506-86481e748b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:59.528459 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e4517-f8c3-46fa-a49d-ec853bb95e00 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:38:59.532564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-2488995b-db40-4bd3-a506-86481e748b27 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:38:59.534953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-2488995b-db40-4bd3-a506-86481e748b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:38:59.558313 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:38:59.597145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54931-6618-4815-ab00-eaeac7e10e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:38:59.598349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54931-6618-4815-ab00-eaeac7e10e8c None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:38:59.599149 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54931-6618-4815-ab00-eaeac7e10e8c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:38:59.599607 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54931-6618-4815-ab00-eaeac7e10e8c None admin] PATH_INFO: `/v3/projects/c5667f138f3a41d2b41486682bb7771c/groups/679ae63fca8c46bebc6c19a396b7b759/roles/d444334199c640a7af820f46e283d49d` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:38:59.603130 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54931-6618-4815-ab00-eaeac7e10e8c None admin] RBAC: Authorizing `identity:create_grant(project_id=c5667f138f3a41d2b41486682bb7771c, group_id=679ae63fca8c46bebc6c19a396b7b759, role_id=d444334199c640a7af820f46e283d49d)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:38:59.606043 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54931-6618-4815-ab00-eaeac7e10e8c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:38:59.627801 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 207/416] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Aug 19 14:38:59 2022] PUT /identity/v3/projects/c5667f138f3a41d2b41486682bb7771c/groups/679ae63fca8c46bebc6c19a396b7b759/roles/d444334199c640a7af820f46e283d49d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:38:59.688084 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 210/417] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 14:39:00.306340 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54931-6618-4815-ab00-eaeac7e10e8c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:00.445306 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54931-6618-4815-ab00-eaeac7e10e8c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:00.485493 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb8e4e-4a46-4b93-b127-0b4462d4e414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:00.486165 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb8e4e-4a46-4b93-b127-0b4462d4e414 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:00.486478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb8e4e-4a46-4b93-b127-0b4462d4e414 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:00.486713 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb8e4e-4a46-4b93-b127-0b4462d4e414 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:00.504624 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb8e4e-4a46-4b93-b127-0b4462d4e414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-5cbb8e4e-4a46-4b93-b127-0b4462d4e414 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:00.510354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:00.512033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:00.513500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 208/418] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:00.524135 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488995b-db40-4bd3-a506-86481e748b27 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:00.552520 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:00.681511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488995b-db40-4bd3-a506-86481e748b27 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:00.721187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8cc28-56d3-4dae-b4a0-11bfde0dc585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:00.722345 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8cc28-56d3-4dae-b4a0-11bfde0dc585 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:00.722833 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8cc28-56d3-4dae-b4a0-11bfde0dc585 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:00.723252 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8cc28-56d3-4dae-b4a0-11bfde0dc585 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:00.724274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8cc28-56d3-4dae-b4a0-11bfde0dc585 None admin] RBAC: Adding query filter params (name=member) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:00.724748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8cc28-56d3-4dae-b4a0-11bfde0dc585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:00.726828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8cc28-56d3-4dae-b4a0-11bfde0dc585 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:00.739278 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 211/419] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:00.746059 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb8e4e-4a46-4b93-b127-0b4462d4e414 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:00.759939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aae8ed-1468-4b21-b162-c2eddb422abf None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:00.760477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aae8ed-1468-4b21-b162-c2eddb422abf None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:00.760877 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aae8ed-1468-4b21-b162-c2eddb422abf None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:00.762447 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 212/420] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:00.771741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9556-b0fd-4a31-8b00-852d2ed366bf None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:00.772016 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9556-b0fd-4a31-8b00-852d2ed366bf None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:00.772284 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9556-b0fd-4a31-8b00-852d2ed366bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:00.797638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-2fba9556-b0fd-4a31-8b00-852d2ed366bf None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:00.798916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-2fba9556-b0fd-4a31-8b00-852d2ed366bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:00.808109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:00.930330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:00.938462 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 213/421] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:00.941867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb8e4e-4a46-4b93-b127-0b4462d4e414 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:00.964790 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d222d-e2d2-4257-9695-5c12229fba7b None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:00.965116 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d222d-e2d2-4257-9695-5c12229fba7b None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:00.965329 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d222d-e2d2-4257-9695-5c12229fba7b None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:00.967003 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 214/422] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:00.972109 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61772cec-65f6-460d-a53e-3bb4f3252908 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:00.972386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61772cec-65f6-460d-a53e-3bb4f3252908 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:00.972652 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61772cec-65f6-460d-a53e-3bb4f3252908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:00.990935 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-61772cec-65f6-460d-a53e-3bb4f3252908 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:00.992118 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-61772cec-65f6-460d-a53e-3bb4f3252908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:01.002976 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949376-0395-4e4f-9b87-286b4de4bc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:01.003650 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949376-0395-4e4f-9b87-286b4de4bc46 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:01.004213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949376-0395-4e4f-9b87-286b4de4bc46 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:01.004510 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949376-0395-4e4f-9b87-286b4de4bc46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:01.126641 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 215/423] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:01.159381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf949376-0395-4e4f-9b87-286b4de4bc46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:01.161836 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf949376-0395-4e4f-9b87-286b4de4bc46 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:01.227965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:01.279389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f1371-8852-4a7a-b6a1-93d7a186b3be None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:01.280043 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f1371-8852-4a7a-b6a1-93d7a186b3be None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:01.280663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f1371-8852-4a7a-b6a1-93d7a186b3be None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:01.282244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 216/424] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:01.299418 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405c57-37df-4785-89db-3064096c9f9d None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:01.300032 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405c57-37df-4785-89db-3064096c9f9d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:01.300533 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405c57-37df-4785-89db-3064096c9f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:01.347201 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-c5405c57-37df-4785-89db-3064096c9f9d None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:01.349103 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-c5405c57-37df-4785-89db-3064096c9f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:01.355913 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 209/425] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:01.361874 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949376-0395-4e4f-9b87-286b4de4bc46 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:01.516490 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949376-0395-4e4f-9b87-286b4de4bc46 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:01.536461 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 217/426] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:01.537902 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5405c57-37df-4785-89db-3064096c9f9d None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:01.566282 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:01.575064 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde4d04-ddbf-4a84-95a3-dde648b2e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:01.576338 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4d04-ddbf-4a84-95a3-dde648b2e1ab None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:01.577503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4d04-ddbf-4a84-95a3-dde648b2e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:01.578158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4d04-ddbf-4a84-95a3-dde648b2e1ab None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:01.580930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde4d04-ddbf-4a84-95a3-dde648b2e1ab None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:01.584694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde4d04-ddbf-4a84-95a3-dde648b2e1ab None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:01.588018 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 210/427] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:39:01 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:01.589353 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde4d04-ddbf-4a84-95a3-dde648b2e1ab None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:01.626310 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:01.716475 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5405c57-37df-4785-89db-3064096c9f9d None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:01.779569 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd125c-ef88-4ae2-9000-516fd613db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:01.780812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd125c-ef88-4ae2-9000-516fd613db95 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:01.781269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd125c-ef88-4ae2-9000-516fd613db95 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:01.782097 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd125c-ef88-4ae2-9000-516fd613db95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:01.784884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde4d04-ddbf-4a84-95a3-dde648b2e1ab None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:01.800755 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd125c-ef88-4ae2-9000-516fd613db95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-76cd125c-ef88-4ae2-9000-516fd613db95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:01.811772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:01.813811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:39:01.815802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:01.819995 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 218/428] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:01.819995 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd125c-ef88-4ae2-9000-516fd613db95 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:01.852382 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145e28f-af54-44c6-a50a-7dbb6c5219af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:01.853740 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145e28f-af54-44c6-a50a-7dbb6c5219af None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:01.854228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145e28f-af54-44c6-a50a-7dbb6c5219af None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:01.854740 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145e28f-af54-44c6-a50a-7dbb6c5219af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:01.874616 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145e28f-af54-44c6-a50a-7dbb6c5219af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-5145e28f-af54-44c6-a50a-7dbb6c5219af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:01.887263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:01.889275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 211/429] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:01.891260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145e28f-af54-44c6-a50a-7dbb6c5219af None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:01.998284 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd125c-ef88-4ae2-9000-516fd613db95 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:02.009266 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:02.030991 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:02.051462 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8635e-d28d-4c09-9264-0cc4631a0eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:02.052491 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8635e-d28d-4c09-9264-0cc4631a0eaa None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:02.052928 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8635e-d28d-4c09-9264-0cc4631a0eaa None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:02.053373 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8635e-d28d-4c09-9264-0cc4631a0eaa None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:02.055119 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8635e-d28d-4c09-9264-0cc4631a0eaa None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:02.057557 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8635e-d28d-4c09-9264-0cc4631a0eaa None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:02.060224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 219/430] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:39:01 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:02.061146 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8635e-d28d-4c09-9264-0cc4631a0eaa None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:02.073297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145e28f-af54-44c6-a50a-7dbb6c5219af None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:02.119010 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a28aa-4ae1-4141-9ef8-61e076c4b7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:02.119989 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a28aa-4ae1-4141-9ef8-61e076c4b7d0 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:02.120398 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a28aa-4ae1-4141-9ef8-61e076c4b7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:02.120804 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a28aa-4ae1-4141-9ef8-61e076c4b7d0 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:02.121822 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a28aa-4ae1-4141-9ef8-61e076c4b7d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:02.122316 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a28aa-4ae1-4141-9ef8-61e076c4b7d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:02.124214 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a28aa-4ae1-4141-9ef8-61e076c4b7d0 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:02.140957 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 212/431] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:02.140957 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a28aa-4ae1-4141-9ef8-61e076c4b7d0 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:02.207793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8635e-d28d-4c09-9264-0cc4631a0eaa None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:02.251078 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3af8cc-6534-4a6b-8c20-79f6b01c298d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:02.251812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3af8cc-6534-4a6b-8c20-79f6b01c298d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:02.252079 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3af8cc-6534-4a6b-8c20-79f6b01c298d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:02.252347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3af8cc-6534-4a6b-8c20-79f6b01c298d None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:02.253008 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3af8cc-6534-4a6b-8c20-79f6b01c298d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:02.253293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3af8cc-6534-4a6b-8c20-79f6b01c298d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:02.254923 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3af8cc-6534-4a6b-8c20-79f6b01c298d None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:02.264733 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 220/432] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:02.265355 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3af8cc-6534-4a6b-8c20-79f6b01c298d None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:02.285057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a28aa-4ae1-4141-9ef8-61e076c4b7d0 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:02.312596 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:02.323737 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:02.326794 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a1d79-201c-4f9d-a496-a08ed5b1908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:02.327437 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1d79-201c-4f9d-a496-a08ed5b1908e None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:02.327711 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1d79-201c-4f9d-a496-a08ed5b1908e None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:02.327979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1d79-201c-4f9d-a496-a08ed5b1908e None admin] PATH_INFO: `/v3/roles/member` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:02.338534 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a1d79-201c-4f9d-a496-a08ed5b1908e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-275a1d79-201c-4f9d-a496-a08ed5b1908e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:02.346097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:02.353090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 213/433] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:02.354879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a1d79-201c-4f9d-a496-a08ed5b1908e None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:02.395484 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3af8cc-6534-4a6b-8c20-79f6b01c298d None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:02.436887 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fd2a1-9053-4fb0-9c62-ea42c5e5bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:02.437521 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fd2a1-9053-4fb0-9c62-ea42c5e5bbe9 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:02.437790 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fd2a1-9053-4fb0-9c62-ea42c5e5bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:02.438094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fd2a1-9053-4fb0-9c62-ea42c5e5bbe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:02.438837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fd2a1-9053-4fb0-9c62-ea42c5e5bbe9 None admin] RBAC: Adding query filter params (group.id=ee4669442c0b4ece96b96987330ef7c5, role.id=d4bd126c45e24b93a90052154a32972b, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:02.439140 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fd2a1-9053-4fb0-9c62-ea42c5e5bbe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:02.440933 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fd2a1-9053-4fb0-9c62-ea42c5e5bbe9 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:02.455716 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 221/434] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 14:39:02 2022] GET /identity/v3/role_assignments?group.id=ee4669442c0b4ece96b96987330ef7c5&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=d4bd126c45e24b93a90052154a32972b => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:02.456597 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fd2a1-9053-4fb0-9c62-ea42c5e5bbe9 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:02.518227 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a1d79-201c-4f9d-a496-a08ed5b1908e None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:02.596351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d865168-c05d-4248-b8e6-f130136cfa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:02.598166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d865168-c05d-4248-b8e6-f130136cfa5d None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:02.598465 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d865168-c05d-4248-b8e6-f130136cfa5d None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:02.598736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d865168-c05d-4248-b8e6-f130136cfa5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:02.604701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fd2a1-9053-4fb0-9c62-ea42c5e5bbe9 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:02.622082 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:02.648624 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02d0c3-7112-46c6-a654-e4ccbcec49f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:02.649346 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02d0c3-7112-46c6-a654-e4ccbcec49f3 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:02.649659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02d0c3-7112-46c6-a654-e4ccbcec49f3 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:02.650135 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02d0c3-7112-46c6-a654-e4ccbcec49f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:02.654544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:02.675631 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d865168-c05d-4248-b8e6-f130136cfa5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:02.677108 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d865168-c05d-4248-b8e6-f130136cfa5d None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:02.739637 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02d0c3-7112-46c6-a654-e4ccbcec49f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:02.741621 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02d0c3-7112-46c6-a654-e4ccbcec49f3 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:02.800905 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 214/435] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:02.802089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d865168-c05d-4248-b8e6-f130136cfa5d None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:02.866778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 222/436] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:02.868037 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b212d6-03c1-4d1c-9e14-e5b386239e17 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:02.868321 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b212d6-03c1-4d1c-9e14-e5b386239e17 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:02.868585 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b212d6-03c1-4d1c-9e14-e5b386239e17 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:02.874009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 223/437] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:02.875761 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b212d6-03c1-4d1c-9e14-e5b386239e17 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:02.893736 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:02.901329 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:02.921721 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d865168-c05d-4248-b8e6-f130136cfa5d None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:02.957771 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5205f-b8d7-4a5a-b0d0-df1756a7538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:02.958409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5205f-b8d7-4a5a-b0d0-df1756a7538e None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:02.958679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5205f-b8d7-4a5a-b0d0-df1756a7538e None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:02.958940 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5205f-b8d7-4a5a-b0d0-df1756a7538e None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:02.959592 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5205f-b8d7-4a5a-b0d0-df1756a7538e None admin] RBAC: Adding query filter params (name=member) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:02.959883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5205f-b8d7-4a5a-b0d0-df1756a7538e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:02.961245 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5205f-b8d7-4a5a-b0d0-df1756a7538e None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:02.969788 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 215/438] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:39:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:02.970589 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5205f-b8d7-4a5a-b0d0-df1756a7538e None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:02.991058 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b212d6-03c1-4d1c-9e14-e5b386239e17 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:03.024898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f04ff3-f3fd-45cf-a0da-5f4ff93df773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:03.025830 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f04ff3-f3fd-45cf-a0da-5f4ff93df773 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:03.026153 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f04ff3-f3fd-45cf-a0da-5f4ff93df773 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:03.026424 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f04ff3-f3fd-45cf-a0da-5f4ff93df773 None admin] PATH_INFO: `/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:03.027555 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f04ff3-f3fd-45cf-a0da-5f4ff93df773 None admin] RBAC: Authorizing `identity:get_project(project_id=63a0f3e7b98c4eb28a2b7a6105ec535b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:03.028990 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f04ff3-f3fd-45cf-a0da-5f4ff93df773 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:03.030664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 224/439] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:39:02 2022] GET /identity/v3/projects/63a0f3e7b98c4eb28a2b7a6105ec535b => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:03.031848 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d6ad-a4eb-4af9-ab4b-9f1b6c94d264 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:03.032077 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d6ad-a4eb-4af9-ab4b-9f1b6c94d264 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:03.032382 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d6ad-a4eb-4af9-ab4b-9f1b6c94d264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:03.049775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-2a60d6ad-a4eb-4af9-ab4b-9f1b6c94d264 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:03.051010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-2a60d6ad-a4eb-4af9-ab4b-9f1b6c94d264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:03.079133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5205f-b8d7-4a5a-b0d0-df1756a7538e None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:03.113086 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d379c-1489-4889-8a55-64272961e5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:03.113729 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d379c-1489-4889-8a55-64272961e5ea None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:03.114037 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d379c-1489-4889-8a55-64272961e5ea None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:03.114314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d379c-1489-4889-8a55-64272961e5ea None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:03.115434 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d379c-1489-4889-8a55-64272961e5ea None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:03.116960 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d379c-1489-4889-8a55-64272961e5ea None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:03.118593 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 216/440] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:39:02 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:03.126127 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d379c-1489-4889-8a55-64272961e5ea None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:03.126288 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 225/441] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:03.126288 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60d6ad-a4eb-4af9-ab4b-9f1b6c94d264 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:03.139502 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:03.153234 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:03.237349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60d6ad-a4eb-4af9-ab4b-9f1b6c94d264 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:03.258099 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d379c-1489-4889-8a55-64272961e5ea None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:03.277740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a94ec-09ce-47b4-a13a-0e00c769a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:03.278413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a94ec-09ce-47b4-a13a-0e00c769a918 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:03.278689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a94ec-09ce-47b4-a13a-0e00c769a918 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:03.278957 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a94ec-09ce-47b4-a13a-0e00c769a918 None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:03.280077 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a94ec-09ce-47b4-a13a-0e00c769a918 None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:03.281645 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a94ec-09ce-47b4-a13a-0e00c769a918 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:03.283346 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 226/442] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:39:03 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:03.284105 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a94ec-09ce-47b4-a13a-0e00c769a918 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:03.300099 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f5ff5-7071-496a-b336-e5899ea4f905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:03.300726 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f5ff5-7071-496a-b336-e5899ea4f905 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:03.301002 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f5ff5-7071-496a-b336-e5899ea4f905 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:03.301277 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f5ff5-7071-496a-b336-e5899ea4f905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:03.380796 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f5ff5-7071-496a-b336-e5899ea4f905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:03.382176 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f5ff5-7071-496a-b336-e5899ea4f905 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:03.383852 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:03.398363 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:03.408555 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a94ec-09ce-47b4-a13a-0e00c769a918 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:03.445381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3af875-1347-497c-aa77-8b5bdd5a189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:03.446047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af875-1347-497c-aa77-8b5bdd5a189b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:03.446327 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af875-1347-497c-aa77-8b5bdd5a189b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:03.446599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af875-1347-497c-aa77-8b5bdd5a189b None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:03.447756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3af875-1347-497c-aa77-8b5bdd5a189b None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:03.449210 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3af875-1347-497c-aa77-8b5bdd5a189b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:03.450826 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 227/443] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:39:03 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:03.451581 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3af875-1347-497c-aa77-8b5bdd5a189b None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:03.493532 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 217/444] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:03.494494 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f5ff5-7071-496a-b336-e5899ea4f905 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:03.562100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3af875-1347-497c-aa77-8b5bdd5a189b None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:03.595616 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f5ff5-7071-496a-b336-e5899ea4f905 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:03.597475 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ba514-43a2-4fec-b710-576e718254a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:03.598114 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ba514-43a2-4fec-b710-576e718254a7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:03.598391 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ba514-43a2-4fec-b710-576e718254a7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:03.598661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ba514-43a2-4fec-b710-576e718254a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:03.599387 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ba514-43a2-4fec-b710-576e718254a7 None admin] RBAC: Adding query filter params (group.id=ee4669442c0b4ece96b96987330ef7c5, role.id=d3126a0397e243eeb3aa834efbabf407, scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:03.599706 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ba514-43a2-4fec-b710-576e718254a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:03.601145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ba514-43a2-4fec-b710-576e718254a7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:03.607436 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 228/445] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 14:39:03 2022] GET /identity/v3/role_assignments?group.id=ee4669442c0b4ece96b96987330ef7c5&scope.project.id=63a0f3e7b98c4eb28a2b7a6105ec535b&role.id=d3126a0397e243eeb3aa834efbabf407 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:03.608245 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ba514-43a2-4fec-b710-576e718254a7 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:03.608814 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:03.634758 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:03.653522 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe744-9bf8-4a43-b85f-db55e9e71279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:03.654324 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe744-9bf8-4a43-b85f-db55e9e71279 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:03.654598 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe744-9bf8-4a43-b85f-db55e9e71279 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:03.654873 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe744-9bf8-4a43-b85f-db55e9e71279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:03.673364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe744-9bf8-4a43-b85f-db55e9e71279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-4d9fe744-9bf8-4a43-b85f-db55e9e71279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:03.678962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:03.679902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:03.680695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 218/446] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:03.683786 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe744-9bf8-4a43-b85f-db55e9e71279 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:03.766095 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ba514-43a2-4fec-b710-576e718254a7 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:03.813708 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95a58a-9198-44a1-b895-54e331abada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:03.815047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95a58a-9198-44a1-b895-54e331abada6 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:03.815461 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95a58a-9198-44a1-b895-54e331abada6 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:03.816218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95a58a-9198-44a1-b895-54e331abada6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:03.816834 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95a58a-9198-44a1-b895-54e331abada6 None admin] RBAC: Adding query filter params (group.id=ee4669442c0b4ece96b96987330ef7c5, role.id=d3126a0397e243eeb3aa834efbabf407, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:03.817304 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95a58a-9198-44a1-b895-54e331abada6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:03.817607 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe744-9bf8-4a43-b85f-db55e9e71279 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:03.819595 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95a58a-9198-44a1-b895-54e331abada6 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:03.831761 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 229/447] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 14:39:03 2022] GET /identity/v3/role_assignments?group.id=ee4669442c0b4ece96b96987330ef7c5&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=d3126a0397e243eeb3aa834efbabf407 => generated 611 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:03.833812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95a58a-9198-44a1-b895-54e331abada6 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:03.865213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b315b29-3b8e-4532-8dc3-19f9d408d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:03.865866 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b315b29-3b8e-4532-8dc3-19f9d408d4ab None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:03.866198 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b315b29-3b8e-4532-8dc3-19f9d408d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:03.866452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b315b29-3b8e-4532-8dc3-19f9d408d4ab None admin] PATH_INFO: `/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:03.867694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b315b29-3b8e-4532-8dc3-19f9d408d4ab None admin] RBAC: Authorizing `identity:get_project(project_id=3a551dfadb7041dd8a9c66dc25bc02a1)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:03.869247 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b315b29-3b8e-4532-8dc3-19f9d408d4ab None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:03.871114 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 219/448] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:39:03 2022] GET /identity/v3/projects/3a551dfadb7041dd8a9c66dc25bc02a1 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:03.877009 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b315b29-3b8e-4532-8dc3-19f9d408d4ab None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:03.950846 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:03.963312 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:04.016095 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95a58a-9198-44a1-b895-54e331abada6 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:04.062562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b315b29-3b8e-4532-8dc3-19f9d408d4ab None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:04.068850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc197-5a94-44b7-88f3-b2ae8c7467ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:04.069512 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc197-5a94-44b7-88f3-b2ae8c7467ef None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:04.069745 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc197-5a94-44b7-88f3-b2ae8c7467ef None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:04.070047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc197-5a94-44b7-88f3-b2ae8c7467ef None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:04.070748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc197-5a94-44b7-88f3-b2ae8c7467ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:04.071046 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc197-5a94-44b7-88f3-b2ae8c7467ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:04.072489 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc197-5a94-44b7-88f3-b2ae8c7467ef None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:04.084488 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 230/449] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:04.090989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc197-5a94-44b7-88f3-b2ae8c7467ef None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:04.116370 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4985413-300a-49fd-ba2f-0b7cdd5d9515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:04.117381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4985413-300a-49fd-ba2f-0b7cdd5d9515 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:04.117662 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4985413-300a-49fd-ba2f-0b7cdd5d9515 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:04.117958 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4985413-300a-49fd-ba2f-0b7cdd5d9515 None admin] PATH_INFO: `/v3/groups/ee4669442c0b4ece96b96987330ef7c5` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:04.119858 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4985413-300a-49fd-ba2f-0b7cdd5d9515 None admin] RBAC: Authorizing `identity:get_group(group_id=ee4669442c0b4ece96b96987330ef7c5)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:04.121656 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4985413-300a-49fd-ba2f-0b7cdd5d9515 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:04.123760 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 220/450] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:39:03 2022] GET /identity/v3/groups/ee4669442c0b4ece96b96987330ef7c5 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:04.132283 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4985413-300a-49fd-ba2f-0b7cdd5d9515 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:04.222070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc197-5a94-44b7-88f3-b2ae8c7467ef None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:04.250227 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4985413-300a-49fd-ba2f-0b7cdd5d9515 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:04.258374 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768894f7-9a64-4c7e-b680-3244dc0873ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:04.258994 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768894f7-9a64-4c7e-b680-3244dc0873ed None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:04.259270 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768894f7-9a64-4c7e-b680-3244dc0873ed None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:04.259576 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768894f7-9a64-4c7e-b680-3244dc0873ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:04.260184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:04.268771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:04.287487 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99c723-254f-42e3-8e57-0d991541596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:04.288107 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99c723-254f-42e3-8e57-0d991541596b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:04.288379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99c723-254f-42e3-8e57-0d991541596b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:04.288652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99c723-254f-42e3-8e57-0d991541596b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:04.289631 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99c723-254f-42e3-8e57-0d991541596b None admin] RBAC: Adding query filter params (group.id=ee4669442c0b4ece96b96987330ef7c5, role.id=d4bd126c45e24b93a90052154a32972b, scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:04.289751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99c723-254f-42e3-8e57-0d991541596b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:04.291596 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99c723-254f-42e3-8e57-0d991541596b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:04.297628 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 221/451] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 14:39:04 2022] GET /identity/v3/role_assignments?group.id=ee4669442c0b4ece96b96987330ef7c5&scope.project.id=3a551dfadb7041dd8a9c66dc25bc02a1&role.id=d4bd126c45e24b93a90052154a32972b => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:04.337579 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768894f7-9a64-4c7e-b680-3244dc0873ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:04.339592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768894f7-9a64-4c7e-b680-3244dc0873ed None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:04.452507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 231/452] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:04.458592 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99c723-254f-42e3-8e57-0d991541596b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:04.570324 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99c723-254f-42e3-8e57-0d991541596b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:04.605090 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da46a6-a8d1-47c5-ad57-e01cf91274f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:04.605729 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da46a6-a8d1-47c5-ad57-e01cf91274f1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:04.606031 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da46a6-a8d1-47c5-ad57-e01cf91274f1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:04.606305 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da46a6-a8d1-47c5-ad57-e01cf91274f1 None admin] PATH_INFO: `/v3/projects/c5667f138f3a41d2b41486682bb7771c` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:04.607444 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da46a6-a8d1-47c5-ad57-e01cf91274f1 None admin] RBAC: Authorizing `identity:get_project(project_id=c5667f138f3a41d2b41486682bb7771c)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:04.608866 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da46a6-a8d1-47c5-ad57-e01cf91274f1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:04.610537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 222/453] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Aug 19 14:39:04 2022] GET /identity/v3/projects/c5667f138f3a41d2b41486682bb7771c => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:04.616249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768894f7-9a64-4c7e-b680-3244dc0873ed None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:04.662005 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:04.724589 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768894f7-9a64-4c7e-b680-3244dc0873ed None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:04.760871 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1d7a2-ced9-4429-8cb7-538ca3f87b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:04.761508 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1d7a2-ced9-4429-8cb7-538ca3f87b51 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:04.761784 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1d7a2-ced9-4429-8cb7-538ca3f87b51 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:04.762134 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1d7a2-ced9-4429-8cb7-538ca3f87b51 None admin] PATH_INFO: `/v3/groups/679ae63fca8c46bebc6c19a396b7b759` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:04.763277 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1d7a2-ced9-4429-8cb7-538ca3f87b51 None admin] RBAC: Authorizing `identity:get_group(group_id=679ae63fca8c46bebc6c19a396b7b759)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:04.764724 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1d7a2-ced9-4429-8cb7-538ca3f87b51 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:04.766359 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 232/454] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Aug 19 14:39:04 2022] GET /identity/v3/groups/679ae63fca8c46bebc6c19a396b7b759 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:04.772377 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da46a6-a8d1-47c5-ad57-e01cf91274f1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:04.816488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:04.878002 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da46a6-a8d1-47c5-ad57-e01cf91274f1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:04.922469 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46637655-2d1b-4743-b085-adc45240087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:04.923311 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46637655-2d1b-4743-b085-adc45240087e None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:04.923670 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46637655-2d1b-4743-b085-adc45240087e None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:04.923963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46637655-2d1b-4743-b085-adc45240087e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:04.924934 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46637655-2d1b-4743-b085-adc45240087e None admin] RBAC: Adding query filter params (group.id=679ae63fca8c46bebc6c19a396b7b759, role.id=d444334199c640a7af820f46e283d49d, scope.project.id=c5667f138f3a41d2b41486682bb7771c) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:04.925431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46637655-2d1b-4743-b085-adc45240087e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:04.927718 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46637655-2d1b-4743-b085-adc45240087e None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:04.935435 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 223/455] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Aug 19 14:39:04 2022] GET /identity/v3/role_assignments?group.id=679ae63fca8c46bebc6c19a396b7b759&scope.project.id=c5667f138f3a41d2b41486682bb7771c&role.id=d444334199c640a7af820f46e283d49d => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:07.434100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397692a-106a-4a0f-8612-cfb5086e2270 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:07.434618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397692a-106a-4a0f-8612-cfb5086e2270 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:07.434618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397692a-106a-4a0f-8612-cfb5086e2270 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:07.436227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 233/456] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:07.442587 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f817a9-877c-45ce-983d-fc52998574e3 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:07.443098 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f817a9-877c-45ce-983d-fc52998574e3 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:07.443172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f817a9-877c-45ce-983d-fc52998574e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:07.465581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-b7f817a9-877c-45ce-983d-fc52998574e3 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:07.466830 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-b7f817a9-877c-45ce-983d-fc52998574e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:07.544719 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 224/457] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:07.669693 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf6a22-fcc7-4cc6-a9d2-a56b79fa0c78 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:07.669693 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf6a22-fcc7-4cc6-a9d2-a56b79fa0c78 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:07.669693 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf6a22-fcc7-4cc6-a9d2-a56b79fa0c78 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:07.670347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 234/458] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:07.676161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99739c8-3ac1-4a26-b524-a99a10768adb None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:07.676780 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99739c8-3ac1-4a26-b524-a99a10768adb None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:07.677272 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99739c8-3ac1-4a26-b524-a99a10768adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:07.698521 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-d99739c8-3ac1-4a26-b524-a99a10768adb None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:07.700234 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-d99739c8-3ac1-4a26-b524-a99a10768adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:07.730765 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:07.778531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 225/459] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:07.845406 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77d30c-516b-4caa-aa8b-2665eeb2b4d8 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:07.845724 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77d30c-516b-4caa-aa8b-2665eeb2b4d8 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:07.846004 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77d30c-516b-4caa-aa8b-2665eeb2b4d8 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:07.847597 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 235/460] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:07.852896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb1a3-d7cc-474a-8372-b5c77f5b3c98 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:07.853226 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb1a3-d7cc-474a-8372-b5c77f5b3c98 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:07.853573 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb1a3-d7cc-474a-8372-b5c77f5b3c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:07.872320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-522eb1a3-d7cc-474a-8372-b5c77f5b3c98 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:07.873511 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-522eb1a3-d7cc-474a-8372-b5c77f5b3c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:07.922939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77d30c-516b-4caa-aa8b-2665eeb2b4d8 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:07.952430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 226/461] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:08.051133 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77d30c-516b-4caa-aa8b-2665eeb2b4d8 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:08.059180 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:08.088704 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e75943-272b-49a9-b653-e75fc30917a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:08.089393 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e75943-272b-49a9-b653-e75fc30917a7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.089675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e75943-272b-49a9-b653-e75fc30917a7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.089961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e75943-272b-49a9-b653-e75fc30917a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.102495 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e75943-272b-49a9-b653-e75fc30917a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:08.104416 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e75943-272b-49a9-b653-e75fc30917a7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:08.108757 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562a5b-d544-48bb-adcd-1693111660c0 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.109041 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562a5b-d544-48bb-adcd-1693111660c0 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.109314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562a5b-d544-48bb-adcd-1693111660c0 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.110936 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 227/462] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:08.118166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f4b54-30b2-4e6b-89bc-6df5aa899a25 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.118447 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f4b54-30b2-4e6b-89bc-6df5aa899a25 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.118721 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f4b54-30b2-4e6b-89bc-6df5aa899a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-25e75943-272b-49a9-b653-e75fc30917a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:08.122592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:08.123483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:08.124409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:08.124409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:08.124409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:08.124409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 236/463] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:08.130969 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e75943-272b-49a9-b653-e75fc30917a7 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:08.140463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-e42f4b54-30b2-4e6b-89bc-6df5aa899a25 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:08.142424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-e42f4b54-30b2-4e6b-89bc-6df5aa899a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:08.224894 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 228/464] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:08.225689 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f4b54-30b2-4e6b-89bc-6df5aa899a25 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:08.251301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e75943-272b-49a9-b653-e75fc30917a7 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:08.265162 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:08.288627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fe868-4499-4e5c-9a6b-186e438e8d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:08.289235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe868-4499-4e5c-9a6b-186e438e8d3b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.289510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe868-4499-4e5c-9a6b-186e438e8d3b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.289777 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe868-4499-4e5c-9a6b-186e438e8d3b None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.290463 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fe868-4499-4e5c-9a6b-186e438e8d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:08.290845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fe868-4499-4e5c-9a6b-186e438e8d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:08.292240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fe868-4499-4e5c-9a6b-186e438e8d3b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:08.305792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 237/465] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:08.306987 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fe868-4499-4e5c-9a6b-186e438e8d3b None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:08.332072 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:08.363740 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f4b54-30b2-4e6b-89bc-6df5aa899a25 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:08.405097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87e850-2449-4fc7-949a-c93c37b9518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:08.406064 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87e850-2449-4fc7-949a-c93c37b9518f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.406554 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87e850-2449-4fc7-949a-c93c37b9518f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.406827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87e850-2449-4fc7-949a-c93c37b9518f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.422963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87e850-2449-4fc7-949a-c93c37b9518f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:08.424924 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87e850-2449-4fc7-949a-c93c37b9518f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:08.429571 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fe868-4499-4e5c-9a6b-186e438e8d3b None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-0a87e850-2449-4fc7-949a-c93c37b9518f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:08.440213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:08.441145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:08.442012 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:08.442012 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:08.442012 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:08.442012 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 229/466] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:08.442668 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87e850-2449-4fc7-949a-c93c37b9518f None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:08.472649 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ea0fd-e405-4a83-95ad-0c6ed3328de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:08.473277 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ea0fd-e405-4a83-95ad-0c6ed3328de7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.473750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ea0fd-e405-4a83-95ad-0c6ed3328de7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.474053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ea0fd-e405-4a83-95ad-0c6ed3328de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.485801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ea0fd-e405-4a83-95ad-0c6ed3328de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:08.487477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ea0fd-e405-4a83-95ad-0c6ed3328de7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-993ea0fd-e405-4a83-95ad-0c6ed3328de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:08.504718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:08.505936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:08.506986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:08.506986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:08.506986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:08.506986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 238/467] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:08.511220 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ea0fd-e405-4a83-95ad-0c6ed3328de7 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:08.531922 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:08.561326 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87e850-2449-4fc7-949a-c93c37b9518f None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:08.582727 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:08.596721 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3939092-4d28-4057-bc1c-0d828c33ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:08.597342 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939092-4d28-4057-bc1c-0d828c33ec97 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.597614 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939092-4d28-4057-bc1c-0d828c33ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.597880 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939092-4d28-4057-bc1c-0d828c33ec97 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.598552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3939092-4d28-4057-bc1c-0d828c33ec97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:08.600005 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3939092-4d28-4057-bc1c-0d828c33ec97 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:08.617240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ea0fd-e405-4a83-95ad-0c6ed3328de7 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:08.622405 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 230/468] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:39:08 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:39:08.623592 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3939092-4d28-4057-bc1c-0d828c33ec97 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:08.671209 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91d5fd-276b-4a04-8068-ff90aef31917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:08.671920 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91d5fd-276b-4a04-8068-ff90aef31917 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.672189 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91d5fd-276b-4a04-8068-ff90aef31917 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.672453 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91d5fd-276b-4a04-8068-ff90aef31917 None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.673153 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91d5fd-276b-4a04-8068-ff90aef31917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:08.673514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91d5fd-276b-4a04-8068-ff90aef31917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:08.675288 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91d5fd-276b-4a04-8068-ff90aef31917 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:08.697430 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 239/469] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:08.697430 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91d5fd-276b-4a04-8068-ff90aef31917 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:08.763487 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3939092-4d28-4057-bc1c-0d828c33ec97 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:08.797097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:08.804287 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63dc70-33a2-402f-b174-75abcf2635ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:08.805284 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63dc70-33a2-402f-b174-75abcf2635ae None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.805572 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63dc70-33a2-402f-b174-75abcf2635ae None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.805839 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63dc70-33a2-402f-b174-75abcf2635ae None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.806580 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63dc70-33a2-402f-b174-75abcf2635ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:08.806884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63dc70-33a2-402f-b174-75abcf2635ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:08.808409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63dc70-33a2-402f-b174-75abcf2635ae None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:08.829638 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 231/470] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:08.829849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91d5fd-276b-4a04-8068-ff90aef31917 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:08.830591 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63dc70-33a2-402f-b174-75abcf2635ae None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:08.864429 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:08.875415 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558354f-b9af-4e65-837e-8c3f0bf59269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:08.876063 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558354f-b9af-4e65-837e-8c3f0bf59269 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.876335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558354f-b9af-4e65-837e-8c3f0bf59269 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.876605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558354f-b9af-4e65-837e-8c3f0bf59269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.888030 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558354f-b9af-4e65-837e-8c3f0bf59269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:08.889575 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558354f-b9af-4e65-837e-8c3f0bf59269 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-2558354f-b9af-4e65-837e-8c3f0bf59269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:08.904846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:08.905809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:08.907273 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:08.907273 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:08.907273 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:08.907273 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 240/471] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:08.907273 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558354f-b9af-4e65-837e-8c3f0bf59269 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:08.956417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63dc70-33a2-402f-b174-75abcf2635ae None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:08.993899 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9af46-f914-46ff-9539-1e9d61e1d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:08.994705 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9af46-f914-46ff-9539-1e9d61e1d2e3 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:08.994991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9af46-f914-46ff-9539-1e9d61e1d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:08.995261 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9af46-f914-46ff-9539-1e9d61e1d2e3 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:08.995902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9af46-f914-46ff-9539-1e9d61e1d2e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:08.997324 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9af46-f914-46ff-9539-1e9d61e1d2e3 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:09.030044 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 232/472] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:39:08 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:39:09.030044 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9af46-f914-46ff-9539-1e9d61e1d2e3 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:09.034902 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558354f-b9af-4e65-837e-8c3f0bf59269 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:09.084336 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:09.095873 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b56f5-7ce9-49a8-95a8-b5fec9462a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:09.096874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b56f5-7ce9-49a8-95a8-b5fec9462a6e None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:09.097200 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b56f5-7ce9-49a8-95a8-b5fec9462a6e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:09.097516 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b56f5-7ce9-49a8-95a8-b5fec9462a6e None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:09.098462 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b56f5-7ce9-49a8-95a8-b5fec9462a6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:09.100987 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b56f5-7ce9-49a8-95a8-b5fec9462a6e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:09.134137 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 241/473] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:39:08 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:39:09.168618 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9af46-f914-46ff-9539-1e9d61e1d2e3 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:09.214661 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5c8c4-aa13-46b6-a52b-d9cc3488a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:09.215299 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5c8c4-aa13-46b6-a52b-d9cc3488a496 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:09.215576 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5c8c4-aa13-46b6-a52b-d9cc3488a496 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:09.215845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5c8c4-aa13-46b6-a52b-d9cc3488a496 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:09.216568 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5c8c4-aa13-46b6-a52b-d9cc3488a496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:09.216873 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5c8c4-aa13-46b6-a52b-d9cc3488a496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:09.218336 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5c8c4-aa13-46b6-a52b-d9cc3488a496 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:09.234453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 233/474] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:09.239756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b56f5-7ce9-49a8-95a8-b5fec9462a6e None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:09.293492 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:09.370199 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b56f5-7ce9-49a8-95a8-b5fec9462a6e None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:09.408986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b814b-306a-4944-a4fd-506dee62b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:09.409592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b814b-306a-4944-a4fd-506dee62b08a None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:09.409863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b814b-306a-4944-a4fd-506dee62b08a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:09.410159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b814b-306a-4944-a4fd-506dee62b08a None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:09.410810 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b814b-306a-4944-a4fd-506dee62b08a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:09.412245 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b814b-306a-4944-a4fd-506dee62b08a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:09.433816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 242/475] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:39:09 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:39:10.926420 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59bb81-db59-439f-9d6a-be4631d3ee62 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:10.926941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59bb81-db59-439f-9d6a-be4631d3ee62 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:10.926941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59bb81-db59-439f-9d6a-be4631d3ee62 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:10.928415 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 234/476] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:10.934252 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1f0f2-1c80-42e2-b4d5-ba2f5aac6cf7 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:10.935071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1f0f2-1c80-42e2-b4d5-ba2f5aac6cf7 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:10.935582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1f0f2-1c80-42e2-b4d5-ba2f5aac6cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:10.955589 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-d4d1f0f2-1c80-42e2-b4d5-ba2f5aac6cf7 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:10.957524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-d4d1f0f2-1c80-42e2-b4d5-ba2f5aac6cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:11.034048 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 243/477] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:11.380185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59bb81-db59-439f-9d6a-be4631d3ee62 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:11.471312 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d962b8-1f44-424b-abdb-fb96527c0039 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:11.471674 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d962b8-1f44-424b-abdb-fb96527c0039 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:11.471998 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d962b8-1f44-424b-abdb-fb96527c0039 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:11.475422 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 244/478] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:11.480987 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b7af-d251-4722-8455-5af534260811 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:11.481330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b7af-d251-4722-8455-5af534260811 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:11.481633 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b7af-d251-4722-8455-5af534260811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:11.503159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-46a6b7af-d251-4722-8455-5af534260811 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:11.504724 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-46a6b7af-d251-4722-8455-5af534260811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:11.505292 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59bb81-db59-439f-9d6a-be4631d3ee62 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:11.516641 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:11.526966 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:11.551603 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f02da-c932-4fec-b201-70314a3c2f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:11.552464 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f02da-c932-4fec-b201-70314a3c2f5d None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:11.552838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f02da-c932-4fec-b201-70314a3c2f5d None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:11.553211 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f02da-c932-4fec-b201-70314a3c2f5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:11.565349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f02da-c932-4fec-b201-70314a3c2f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-0c0f02da-c932-4fec-b201-70314a3c2f5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:11.570621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:11.571609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:11.572471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:11.573232 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 235/479] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:11.580170 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f02da-c932-4fec-b201-70314a3c2f5d None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:11.592573 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 245/480] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:11.624850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40811f04-9e38-47d8-9d92-f962687ea96e None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:11.625309 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40811f04-9e38-47d8-9d92-f962687ea96e None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:11.625679 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40811f04-9e38-47d8-9d92-f962687ea96e None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:11.627422 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 246/481] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:11.632318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1764e07-f6af-4f00-aa46-ac12635b7bd2 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:11.632653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1764e07-f6af-4f00-aa46-ac12635b7bd2 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:11.633027 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1764e07-f6af-4f00-aa46-ac12635b7bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:11.657216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-a1764e07-f6af-4f00-aa46-ac12635b7bd2 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:11.659204 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-a1764e07-f6af-4f00-aa46-ac12635b7bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:11.731281 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f02da-c932-4fec-b201-70314a3c2f5d None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:11.757121 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 247/482] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:11.773555 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01479-885c-4be5-b350-cf1751096d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:11.773992 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01479-885c-4be5-b350-cf1751096d81 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:11.774271 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01479-885c-4be5-b350-cf1751096d81 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:11.774541 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01479-885c-4be5-b350-cf1751096d81 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:11.775450 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b01479-885c-4be5-b350-cf1751096d81 None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:11.776215 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b01479-885c-4be5-b350-cf1751096d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:11.777655 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b01479-885c-4be5-b350-cf1751096d81 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:11.793852 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 236/483] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:11.795526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1764e07-f6af-4f00-aa46-ac12635b7bd2 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:11.883774 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0038fa4-715f-4fa0-b891-1cebaa5385eb None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:11.883774 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0038fa4-715f-4fa0-b891-1cebaa5385eb None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:11.883774 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0038fa4-715f-4fa0-b891-1cebaa5385eb None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:11.883774 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 237/484] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:11.892013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c82f5-2177-4275-8f85-40e4a9602f56 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:11.892293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c82f5-2177-4275-8f85-40e4a9602f56 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:11.892585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c82f5-2177-4275-8f85-40e4a9602f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:11.898532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:11.913170 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-3f5c82f5-2177-4275-8f85-40e4a9602f56 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:11.914427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-3f5c82f5-2177-4275-8f85-40e4a9602f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:11.916770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1764e07-f6af-4f00-aa46-ac12635b7bd2 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:11.949083 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:11.962660 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac860f6-9643-4a30-8298-4ffd3fb3df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:11.963444 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac860f6-9643-4a30-8298-4ffd3fb3df37 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:11.963828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac860f6-9643-4a30-8298-4ffd3fb3df37 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:11.964257 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac860f6-9643-4a30-8298-4ffd3fb3df37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:11.978726 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac860f6-9643-4a30-8298-4ffd3fb3df37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:11.980241 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac860f6-9643-4a30-8298-4ffd3fb3df37 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-eac860f6-9643-4a30-8298-4ffd3fb3df37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:11.998691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:11.999650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:12.000507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:12.000507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:12.000507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:12.000507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 248/485] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:12.001416 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac860f6-9643-4a30-8298-4ffd3fb3df37 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.012842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 238/486] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:12.022910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c82f5-2177-4275-8f85-40e4a9602f56 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.132267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac860f6-9643-4a30-8298-4ffd3fb3df37 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:12.140726 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c82f5-2177-4275-8f85-40e4a9602f56 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:12.172558 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528961a-71ed-4eb0-9969-576b599b0801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:12.173399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528961a-71ed-4eb0-9969-576b599b0801 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:12.173810 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528961a-71ed-4eb0-9969-576b599b0801 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:12.174195 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528961a-71ed-4eb0-9969-576b599b0801 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:12.177452 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:12.178433 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b79ec-48c7-492b-b3e9-7f93b2c8d596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:12.178931 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b79ec-48c7-492b-b3e9-7f93b2c8d596 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:12.179199 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b79ec-48c7-492b-b3e9-7f93b2c8d596 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:12.179529 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b79ec-48c7-492b-b3e9-7f93b2c8d596 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:12.180159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b79ec-48c7-492b-b3e9-7f93b2c8d596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:12.180459 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b79ec-48c7-492b-b3e9-7f93b2c8d596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:12.181940 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b79ec-48c7-492b-b3e9-7f93b2c8d596 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:12.188721 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528961a-71ed-4eb0-9969-576b599b0801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-d528961a-71ed-4eb0-9969-576b599b0801 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:12.194070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:12.195175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:12.196163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:12.199415 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 239/487] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:12.200206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 249/488] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:12.200514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b79ec-48c7-492b-b3e9-7f93b2c8d596 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.200934 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528961a-71ed-4eb0-9969-576b599b0801 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.227043 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:12.314141 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528961a-71ed-4eb0-9969-576b599b0801 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:12.319407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b79ec-48c7-492b-b3e9-7f93b2c8d596 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:12.354782 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4246e-763b-46ce-8836-16041b6fcf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:12.355419 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4246e-763b-46ce-8836-16041b6fcf59 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:12.355695 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4246e-763b-46ce-8836-16041b6fcf59 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:12.355966 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4246e-763b-46ce-8836-16041b6fcf59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:12.356297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608167b-a457-425c-af0d-d152dddd098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:12.356927 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608167b-a457-425c-af0d-d152dddd098c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:12.357201 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608167b-a457-425c-af0d-d152dddd098c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:12.357470 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608167b-a457-425c-af0d-d152dddd098c None admin] PATH_INFO: `/v3/roles/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:12.364536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4246e-763b-46ce-8836-16041b6fcf59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:12.366081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4246e-763b-46ce-8836-16041b6fcf59 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:12.371688 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608167b-a457-425c-af0d-d152dddd098c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-3608167b-a457-425c-af0d-d152dddd098c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:12.377578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:12.378561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:12.379354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-04e4246e-763b-46ce-8836-16041b6fcf59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:12.380413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:12.381514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 250/489] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:12.382740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4246e-763b-46ce-8836-16041b6fcf59 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.385954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 240/490] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:12.386412 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608167b-a457-425c-af0d-d152dddd098c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.442677 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:12.483731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:12.500462 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4246e-763b-46ce-8836-16041b6fcf59 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:12.507690 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608167b-a457-425c-af0d-d152dddd098c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:12.535445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024786d-9a20-4bfc-aa9a-5910a6aaf357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:12.536062 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024786d-9a20-4bfc-aa9a-5910a6aaf357 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:12.536340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024786d-9a20-4bfc-aa9a-5910a6aaf357 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:12.536611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024786d-9a20-4bfc-aa9a-5910a6aaf357 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:12.537278 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024786d-9a20-4bfc-aa9a-5910a6aaf357 None admin] RBAC: Adding query filter params (name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:12.537604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024786d-9a20-4bfc-aa9a-5910a6aaf357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:12.539047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024786d-9a20-4bfc-aa9a-5910a6aaf357 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:12.546447 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d86425-63e7-4cb7-aedb-d2c8124ad914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:12.547084 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d86425-63e7-4cb7-aedb-d2c8124ad914 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:12.547405 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d86425-63e7-4cb7-aedb-d2c8124ad914 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:12.547632 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 251/491] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:12.548500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024786d-9a20-4bfc-aa9a-5910a6aaf357 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.551537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d86425-63e7-4cb7-aedb-d2c8124ad914 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:12.564239 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d86425-63e7-4cb7-aedb-d2c8124ad914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-d8d86425-63e7-4cb7-aedb-d2c8124ad914 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:12.569772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:12.570891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:12.571875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:12.574076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 241/492] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:12.574960 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d86425-63e7-4cb7-aedb-d2c8124ad914 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.654961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024786d-9a20-4bfc-aa9a-5910a6aaf357 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:12.672061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:12.678954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d86425-63e7-4cb7-aedb-d2c8124ad914 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:12.689578 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108529a-ad3a-4f75-b303-c0bc02bd036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:12.690305 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108529a-ad3a-4f75-b303-c0bc02bd036b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:12.690585 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108529a-ad3a-4f75-b303-c0bc02bd036b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:12.690859 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108529a-ad3a-4f75-b303-c0bc02bd036b None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:12.691628 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108529a-ad3a-4f75-b303-c0bc02bd036b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:12.691941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108529a-ad3a-4f75-b303-c0bc02bd036b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:12.693488 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108529a-ad3a-4f75-b303-c0bc02bd036b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:12.712777 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257b04d-25c3-4348-940f-fbc0b52eb930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:12.713390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257b04d-25c3-4348-940f-fbc0b52eb930 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:12.713666 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257b04d-25c3-4348-940f-fbc0b52eb930 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:12.714008 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257b04d-25c3-4348-940f-fbc0b52eb930 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:12.714686 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257b04d-25c3-4348-940f-fbc0b52eb930 None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:12.714987 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257b04d-25c3-4348-940f-fbc0b52eb930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:12.716359 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257b04d-25c3-4348-940f-fbc0b52eb930 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:12.724653 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 242/493] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:12.725264 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257b04d-25c3-4348-940f-fbc0b52eb930 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.727818 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:12.732179 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 252/494] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:12.733043 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108529a-ad3a-4f75-b303-c0bc02bd036b None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.847819 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108529a-ad3a-4f75-b303-c0bc02bd036b None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:12.848546 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257b04d-25c3-4348-940f-fbc0b52eb930 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:12.892625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dd90d-3cf0-471a-9be5-c56c5451a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:12.892861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72d7d1-77f5-40e3-a5b7-0046e12191a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:12.893235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dd90d-3cf0-471a-9be5-c56c5451a942 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:12.893427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d7d1-77f5-40e3-a5b7-0046e12191a5 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:12.893524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dd90d-3cf0-471a-9be5-c56c5451a942 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:12.893707 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d7d1-77f5-40e3-a5b7-0046e12191a5 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:12.893799 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dd90d-3cf0-471a-9be5-c56c5451a942 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:12.894009 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d7d1-77f5-40e3-a5b7-0046e12191a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:12.894450 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42dd90d-3cf0-471a-9be5-c56c5451a942 None admin] RBAC: Adding query filter params (name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:12.894750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42dd90d-3cf0-471a-9be5-c56c5451a942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:12.896147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42dd90d-3cf0-471a-9be5-c56c5451a942 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:12.905090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 253/495] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:12.905520 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72d7d1-77f5-40e3-a5b7-0046e12191a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:12.905885 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dd90d-3cf0-471a-9be5-c56c5451a942 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.907099 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72d7d1-77f5-40e3-a5b7-0046e12191a5 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-4b72d7d1-77f5-40e3-a5b7-0046e12191a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:12.925339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:12.926463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:12.927313 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:12.927313 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:12.927313 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:12.927313 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 243/496] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:12.927898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72d7d1-77f5-40e3-a5b7-0046e12191a5 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:12.961207 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:12.993363 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:13.038030 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dd90d-3cf0-471a-9be5-c56c5451a942 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.045952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72d7d1-77f5-40e3-a5b7-0046e12191a5 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.079912 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ba344-4e4d-4d9f-bfb0-b2ed6fab07eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.080543 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ba344-4e4d-4d9f-bfb0-b2ed6fab07eb None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.080815 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ba344-4e4d-4d9f-bfb0-b2ed6fab07eb None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.081080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ba344-4e4d-4d9f-bfb0-b2ed6fab07eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.088190 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01bdad-769b-47eb-b1bb-179ba0423dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.088484 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01bdad-769b-47eb-b1bb-179ba0423dbd None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.088760 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01bdad-769b-47eb-b1bb-179ba0423dbd None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.089029 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01bdad-769b-47eb-b1bb-179ba0423dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.091549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ba344-4e4d-4d9f-bfb0-b2ed6fab07eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.093011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ba344-4e4d-4d9f-bfb0-b2ed6fab07eb None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-324ba344-4e4d-4d9f-bfb0-b2ed6fab07eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:13.108456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:13.109530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:13.110449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:13.110449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:13.110449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:13.110449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 254/497] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:13.110449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ba344-4e4d-4d9f-bfb0-b2ed6fab07eb None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:13.159413 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01bdad-769b-47eb-b1bb-179ba0423dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.160869 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01bdad-769b-47eb-b1bb-179ba0423dbd None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:13.220487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:13.231443 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:13.231589 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ba344-4e4d-4d9f-bfb0-b2ed6fab07eb None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.268522 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f2d54-bd09-4e7f-bd73-b882c3de176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.269155 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f2d54-bd09-4e7f-bd73-b882c3de176b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.269429 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f2d54-bd09-4e7f-bd73-b882c3de176b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.269745 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f2d54-bd09-4e7f-bd73-b882c3de176b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.280297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 244/498] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:13.281135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01bdad-769b-47eb-b1bb-179ba0423dbd None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:13.282179 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f2d54-bd09-4e7f-bd73-b882c3de176b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.283676 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f2d54-bd09-4e7f-bd73-b882c3de176b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-762f2d54-bd09-4e7f-bd73-b882c3de176b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:13.298860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:13.299798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:13.300626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:13.300626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:13.300626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:13.300626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 255/499] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:13.300847 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f2d54-bd09-4e7f-bd73-b882c3de176b None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:13.391529 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01bdad-769b-47eb-b1bb-179ba0423dbd None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.415318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f2d54-bd09-4e7f-bd73-b882c3de176b None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.427464 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f86b8-c249-4786-9ca4-763e3c5c5a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.428386 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f86b8-c249-4786-9ca4-763e3c5c5a04 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.428660 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f86b8-c249-4786-9ca4-763e3c5c5a04 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.428926 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f86b8-c249-4786-9ca4-763e3c5c5a04 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.429612 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f86b8-c249-4786-9ca4-763e3c5c5a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:13.429934 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f86b8-c249-4786-9ca4-763e3c5c5a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.431387 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f86b8-c249-4786-9ca4-763e3c5c5a04 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:13.444572 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 245/500] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:13.445189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f86b8-c249-4786-9ca4-763e3c5c5a04 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:13.460854 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec560f11-e7cd-424b-81e4-4f2f5110215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.461469 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec560f11-e7cd-424b-81e4-4f2f5110215a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.461749 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec560f11-e7cd-424b-81e4-4f2f5110215a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.462050 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec560f11-e7cd-424b-81e4-4f2f5110215a None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.462739 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec560f11-e7cd-424b-81e4-4f2f5110215a None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:13.463135 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec560f11-e7cd-424b-81e4-4f2f5110215a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.464607 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec560f11-e7cd-424b-81e4-4f2f5110215a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:13.465440 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:13.477160 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 256/501] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:13.477941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec560f11-e7cd-424b-81e4-4f2f5110215a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:13.480887 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:13.563126 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f86b8-c249-4786-9ca4-763e3c5c5a04 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.582578 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec560f11-e7cd-424b-81e4-4f2f5110215a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.599321 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d1505-5b33-4001-a7da-1df02850482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.599981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d1505-5b33-4001-a7da-1df02850482d None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.600257 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d1505-5b33-4001-a7da-1df02850482d None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.600535 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d1505-5b33-4001-a7da-1df02850482d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.611616 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d1505-5b33-4001-a7da-1df02850482d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.613062 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d1505-5b33-4001-a7da-1df02850482d None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:13.617285 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d8c0d-d4ff-4431-a7ce-48f72df2490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.618097 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d8c0d-d4ff-4431-a7ce-48f72df2490a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.618430 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d8c0d-d4ff-4431-a7ce-48f72df2490a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.618843 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d8c0d-d4ff-4431-a7ce-48f72df2490a None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.619884 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d8c0d-d4ff-4431-a7ce-48f72df2490a None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:13.620232 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d8c0d-d4ff-4431-a7ce-48f72df2490a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.621817 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d8c0d-d4ff-4431-a7ce-48f72df2490a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-b13d1505-5b33-4001-a7da-1df02850482d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:13.627314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:13.628365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:13.629335 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:13.629335 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:13.629335 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:13.633023 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 246/502] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:13.633755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d1505-5b33-4001-a7da-1df02850482d None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:13.635690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 257/503] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:13.636635 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d8c0d-d4ff-4431-a7ce-48f72df2490a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:13.701351 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:13.704999 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:13.744236 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d1505-5b33-4001-a7da-1df02850482d None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.744925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d8c0d-d4ff-4431-a7ce-48f72df2490a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.784386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a343af9-ac78-4cbe-8646-7949a750aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.784991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbf3d1-fcf2-42da-9078-93e153c14ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.785120 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a343af9-ac78-4cbe-8646-7949a750aa54 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.785302 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a343af9-ac78-4cbe-8646-7949a750aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.785567 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a343af9-ac78-4cbe-8646-7949a750aa54 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.785713 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf3d1-fcf2-42da-9078-93e153c14ab1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.785995 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf3d1-fcf2-42da-9078-93e153c14ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.786255 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf3d1-fcf2-42da-9078-93e153c14ab1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.795648 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbf3d1-fcf2-42da-9078-93e153c14ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.796313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a343af9-ac78-4cbe-8646-7949a750aa54 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.797115 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbf3d1-fcf2-42da-9078-93e153c14ab1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:13.797757 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a343af9-ac78-4cbe-8646-7949a750aa54 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-49fbf3d1-fcf2-42da-9078-93e153c14ab1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:13.811749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:13.812844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:13.814117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 247/504] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:13.815069 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbf3d1-fcf2-42da-9078-93e153c14ab1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-4a343af9-ac78-4cbe-8646-7949a750aa54 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:13.816925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:13.817793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:13.818765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:13.818765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:13.818765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:13.818765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:13.818765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:13.818765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:13.818765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:13.818765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:13.818765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 14:39:13.818765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:13.822315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 258/505] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:13.823471 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a343af9-ac78-4cbe-8646-7949a750aa54 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:13.933270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbf3d1-fcf2-42da-9078-93e153c14ab1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.940059 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a343af9-ac78-4cbe-8646-7949a750aa54 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:13.965712 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:13.967943 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:13.973406 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbd4b8-8223-4a9e-a0ad-b9343de1a2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.974129 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd4b8-8223-4a9e-a0ad-b9343de1a2fc None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.974443 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd4b8-8223-4a9e-a0ad-b9343de1a2fc None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.974756 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd4b8-8223-4a9e-a0ad-b9343de1a2fc None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.975478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbd4b8-8223-4a9e-a0ad-b9343de1a2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:13.975919 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbd4b8-8223-4a9e-a0ad-b9343de1a2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.977573 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbd4b8-8223-4a9e-a0ad-b9343de1a2fc None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:13.981699 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc0c0-fbdb-48aa-9462-5626b1724a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:13.982706 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc0c0-fbdb-48aa-9462-5626b1724a88 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:13.982706 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc0c0-fbdb-48aa-9462-5626b1724a88 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:13.983119 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc0c0-fbdb-48aa-9462-5626b1724a88 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:13.991199 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc0c0-fbdb-48aa-9462-5626b1724a88 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:13.991753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 248/506] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:13.992558 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbd4b8-8223-4a9e-a0ad-b9343de1a2fc None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:13.992728 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc0c0-fbdb-48aa-9462-5626b1724a88 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-dffcc0c0-fbdb-48aa-9462-5626b1724a88 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:14.006916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:14.008011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:14.009036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 259/507] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:14.009685 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc0c0-fbdb-48aa-9462-5626b1724a88 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:14.101505 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbd4b8-8223-4a9e-a0ad-b9343de1a2fc None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:14.113673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc0c0-fbdb-48aa-9462-5626b1724a88 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:14.138239 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869a0b1-dd2d-4f18-a08b-ae0e9501e9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:14.138937 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869a0b1-dd2d-4f18-a08b-ae0e9501e9e0 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:14.139097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869a0b1-dd2d-4f18-a08b-ae0e9501e9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:14.139381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869a0b1-dd2d-4f18-a08b-ae0e9501e9e0 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:14.140117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869a0b1-dd2d-4f18-a08b-ae0e9501e9e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:14.140402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869a0b1-dd2d-4f18-a08b-ae0e9501e9e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:14.141824 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869a0b1-dd2d-4f18-a08b-ae0e9501e9e0 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:14.151641 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6947295-a0e2-4b14-adc9-1be12f837520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:14.152249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6947295-a0e2-4b14-adc9-1be12f837520 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:14.152540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6947295-a0e2-4b14-adc9-1be12f837520 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:14.152795 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6947295-a0e2-4b14-adc9-1be12f837520 None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:14.153523 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6947295-a0e2-4b14-adc9-1be12f837520 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:14.153827 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6947295-a0e2-4b14-adc9-1be12f837520 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:14.155297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6947295-a0e2-4b14-adc9-1be12f837520 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:14.173024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 260/508] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 14:39:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:14.173854 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6947295-a0e2-4b14-adc9-1be12f837520 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:14.186820 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 249/509] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 14:39:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:14.187526 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869a0b1-dd2d-4f18-a08b-ae0e9501e9e0 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:14.219567 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:14.240457 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:14.281305 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6947295-a0e2-4b14-adc9-1be12f837520 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:14.301279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869a0b1-dd2d-4f18-a08b-ae0e9501e9e0 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:14.316395 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e8085-6cc9-483f-adbc-9d1df4e87a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:14.317021 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8085-6cc9-483f-adbc-9d1df4e87a6b None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:14.317292 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8085-6cc9-483f-adbc-9d1df4e87a6b None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:14.317552 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8085-6cc9-483f-adbc-9d1df4e87a6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:14.324658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e8085-6cc9-483f-adbc-9d1df4e87a6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:14.326141 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e8085-6cc9-483f-adbc-9d1df4e87a6b None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-c93e8085-6cc9-483f-adbc-9d1df4e87a6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:14.338496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:14.339511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:14.340556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:14.340556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:14.340556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:14.340556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:14.340556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:14.340556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:14.340556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:14.340556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:14.340556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 261/510] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:14.340556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e8085-6cc9-483f-adbc-9d1df4e87a6b None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:14.342102 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730f52e-1f09-4f05-9da9-4bf602acd9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:14.342783 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730f52e-1f09-4f05-9da9-4bf602acd9f4 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:14.343127 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730f52e-1f09-4f05-9da9-4bf602acd9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:14.343449 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730f52e-1f09-4f05-9da9-4bf602acd9f4 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:14.344244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730f52e-1f09-4f05-9da9-4bf602acd9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:14.345393 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730f52e-1f09-4f05-9da9-4bf602acd9f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:14.346081 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730f52e-1f09-4f05-9da9-4bf602acd9f4 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:14.363716 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 250/511] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Aug 19 14:39:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:14.364523 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730f52e-1f09-4f05-9da9-4bf602acd9f4 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:14.449240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:14.452503 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e8085-6cc9-483f-adbc-9d1df4e87a6b None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:14.473020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730f52e-1f09-4f05-9da9-4bf602acd9f4 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:14.474798 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:14.488323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589d949-f477-4752-86c5-1a2f9b87b879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:14.488969 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589d949-f477-4752-86c5-1a2f9b87b879 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:14.489249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589d949-f477-4752-86c5-1a2f9b87b879 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:14.489522 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589d949-f477-4752-86c5-1a2f9b87b879 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:14.509524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933818b-f179-41ae-ac0d-fcc92bea01d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:14.510163 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933818b-f179-41ae-ac0d-fcc92bea01d1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:14.510442 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933818b-f179-41ae-ac0d-fcc92bea01d1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:14.510712 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933818b-f179-41ae-ac0d-fcc92bea01d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:14.569262 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589d949-f477-4752-86c5-1a2f9b87b879 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:14.570993 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589d949-f477-4752-86c5-1a2f9b87b879 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:14.580003 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933818b-f179-41ae-ac0d-fcc92bea01d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:14.581449 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933818b-f179-41ae-ac0d-fcc92bea01d1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:14.674038 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:14.677868 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 262/512] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:14.678541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589d949-f477-4752-86c5-1a2f9b87b879 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:14.694010 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 251/513] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:14.694010 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933818b-f179-41ae-ac0d-fcc92bea01d1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:14.694945 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:14.786656 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589d949-f477-4752-86c5-1a2f9b87b879 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:14.791486 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933818b-f179-41ae-ac0d-fcc92bea01d1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:14.827534 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c22e2-ad56-417a-a0de-b90927678f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:14.828418 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c22e2-ad56-417a-a0de-b90927678f1f None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:14.829531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c22e2-ad56-417a-a0de-b90927678f1f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:14.829531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c22e2-ad56-417a-a0de-b90927678f1f None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:14.829721 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c22e2-ad56-417a-a0de-b90927678f1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:14.829898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c22e2-ad56-417a-a0de-b90927678f1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:14.831388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c22e2-ad56-417a-a0de-b90927678f1f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:14.831504 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1274b4-bfc7-442a-9dd9-2add87d6aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:14.832003 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1274b4-bfc7-442a-9dd9-2add87d6aa82 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:14.832276 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1274b4-bfc7-442a-9dd9-2add87d6aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:14.832540 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1274b4-bfc7-442a-9dd9-2add87d6aa82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:14.852295 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 263/514] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:14.853106 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c22e2-ad56-417a-a0de-b90927678f1f None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:14.907583 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1274b4-bfc7-442a-9dd9-2add87d6aa82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:14.909088 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1274b4-bfc7-442a-9dd9-2add87d6aa82 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:14.910948 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:14.920048 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:14.962787 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c22e2-ad56-417a-a0de-b90927678f1f None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:14.997352 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7410ae6-a7ad-4f16-a4f7-4c788e16f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:14.998016 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410ae6-a7ad-4f16-a4f7-4c788e16f2ea None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:14.998294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410ae6-a7ad-4f16-a4f7-4c788e16f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:14.998562 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410ae6-a7ad-4f16-a4f7-4c788e16f2ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:15.008731 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7410ae6-a7ad-4f16-a4f7-4c788e16f2ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:15.010925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7410ae6-a7ad-4f16-a4f7-4c788e16f2ea None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:15.011594 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 252/515] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:15.012563 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1274b4-bfc7-442a-9dd9-2add87d6aa82 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-f7410ae6-a7ad-4f16-a4f7-4c788e16f2ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:15.028181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:15.029301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:15.030313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:15.030313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:15.030313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:15.030313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 264/516] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:15.030525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7410ae6-a7ad-4f16-a4f7-4c788e16f2ea None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:15.139043 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1274b4-bfc7-442a-9dd9-2add87d6aa82 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:15.140548 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:15.145721 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7410ae6-a7ad-4f16-a4f7-4c788e16f2ea None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:15.159553 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:15.176809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc2422-6d6c-4e2a-abb7-b4420b2de9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:15.177444 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc2422-6d6c-4e2a-abb7-b4420b2de9f1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:15.177718 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc2422-6d6c-4e2a-abb7-b4420b2de9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:15.178024 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc2422-6d6c-4e2a-abb7-b4420b2de9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:15.182338 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97898ace-935f-4354-b0d9-4975b042a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:15.182982 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898ace-935f-4354-b0d9-4975b042a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:15.183166 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898ace-935f-4354-b0d9-4975b042a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:15.183430 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898ace-935f-4354-b0d9-4975b042a7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:15.184154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97898ace-935f-4354-b0d9-4975b042a7a9 None admin] RBAC: Adding query filter params (role.id=a0c07ffc05d54106b2f356d6f76ae54b, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=c1a9ed9280d249f9a76d037ff8407082) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:15.184455 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97898ace-935f-4354-b0d9-4975b042a7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:15.186009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97898ace-935f-4354-b0d9-4975b042a7a9 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:15.190587 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc2422-6d6c-4e2a-abb7-b4420b2de9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:15.192040 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc2422-6d6c-4e2a-abb7-b4420b2de9f1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:15.192169 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 265/517] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:39:15 2022] GET /identity/v3/role_assignments?user.id=c1a9ed9280d249f9a76d037ff8407082&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=a0c07ffc05d54106b2f356d6f76ae54b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:15.192876 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97898ace-935f-4354-b0d9-4975b042a7a9 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-fccc2422-6d6c-4e2a-abb7-b4420b2de9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:15.224424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:15.225547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:15.226546 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:15.226546 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:15.226546 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:15.233074 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 253/518] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:15.236365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc2422-6d6c-4e2a-abb7-b4420b2de9f1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:15.378164 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97898ace-935f-4354-b0d9-4975b042a7a9 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:15.383507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc2422-6d6c-4e2a-abb7-b4420b2de9f1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:15.422246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b8d6c-87c2-491e-8a02-8fb0b40cd44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:15.422917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b8d6c-87c2-491e-8a02-8fb0b40cd44d None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:15.423237 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b8d6c-87c2-491e-8a02-8fb0b40cd44d None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:15.423530 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b8d6c-87c2-491e-8a02-8fb0b40cd44d None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:15.424179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b8d6c-87c2-491e-8a02-8fb0b40cd44d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:15.424508 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b8d6c-87c2-491e-8a02-8fb0b40cd44d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:15.425875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b8d6c-87c2-491e-8a02-8fb0b40cd44d None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:15.438618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f7d98-95d2-4079-b516-1213333112e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:15.440121 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 254/519] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:15.440637 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7d98-95d2-4079-b516-1213333112e1 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:15.440968 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b8d6c-87c2-491e-8a02-8fb0b40cd44d None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:15.441309 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7d98-95d2-4079-b516-1213333112e1 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:15.441772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7d98-95d2-4079-b516-1213333112e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:15.462205 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:15.470716 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f7d98-95d2-4079-b516-1213333112e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:15.473293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f7d98-95d2-4079-b516-1213333112e1 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-b23f7d98-95d2-4079-b516-1213333112e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:15.501588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:15.502717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:15.503775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:15.503775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:15.503775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:15.503775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 266/520] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:15.503775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f7d98-95d2-4079-b516-1213333112e1 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:15.538290 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:15.581638 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b8d6c-87c2-491e-8a02-8fb0b40cd44d None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:15.623271 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f7d98-95d2-4079-b516-1213333112e1 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:15.624073 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc930f-c867-4486-b52e-528a2159c499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:15.624788 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc930f-c867-4486-b52e-528a2159c499 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:15.625110 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc930f-c867-4486-b52e-528a2159c499 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:15.625458 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc930f-c867-4486-b52e-528a2159c499 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:15.626403 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc930f-c867-4486-b52e-528a2159c499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:15.626747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc930f-c867-4486-b52e-528a2159c499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:15.628885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc930f-c867-4486-b52e-528a2159c499 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:15.648904 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 255/521] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:15.648904 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc930f-c867-4486-b52e-528a2159c499 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:15.669350 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530be61-16c1-4bb9-b792-13fd76afe451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:15.671274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530be61-16c1-4bb9-b792-13fd76afe451 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:15.671274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530be61-16c1-4bb9-b792-13fd76afe451 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:15.671495 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530be61-16c1-4bb9-b792-13fd76afe451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:15.678977 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530be61-16c1-4bb9-b792-13fd76afe451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:15.680054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530be61-16c1-4bb9-b792-13fd76afe451 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-2530be61-16c1-4bb9-b792-13fd76afe451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:15.697408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:15.698504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:15.699357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:15.699357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:15.699357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:15.699357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:15.699357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:15.699357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:15.699357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:15.699357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:15.699357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 267/522] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:15.700308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530be61-16c1-4bb9-b792-13fd76afe451 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:15.761890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:15.790658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc930f-c867-4486-b52e-528a2159c499 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:15.803061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:15.819587 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530be61-16c1-4bb9-b792-13fd76afe451 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:15.837574 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d5d1f-8400-4253-b806-f8f9f78330ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:15.838480 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d5d1f-8400-4253-b806-f8f9f78330ab None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:15.838802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d5d1f-8400-4253-b806-f8f9f78330ab None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:15.839105 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d5d1f-8400-4253-b806-f8f9f78330ab None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:15.839840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d5d1f-8400-4253-b806-f8f9f78330ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:15.840245 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d5d1f-8400-4253-b806-f8f9f78330ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:15.841891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d5d1f-8400-4253-b806-f8f9f78330ab None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:15.861717 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 256/523] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:15.861961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95d9b-a53e-4435-bdf2-9854314c1b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:15.861961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95d9b-a53e-4435-bdf2-9854314c1b2c None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:15.861961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95d9b-a53e-4435-bdf2-9854314c1b2c None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:15.862193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d5d1f-8400-4253-b806-f8f9f78330ab None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:15.862262 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95d9b-a53e-4435-bdf2-9854314c1b2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:15.869899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95d9b-a53e-4435-bdf2-9854314c1b2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:15.871415 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95d9b-a53e-4435-bdf2-9854314c1b2c None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-93c95d9b-a53e-4435-bdf2-9854314c1b2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:15.883065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:15.883939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:15.885012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:15.885012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:15.885012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:15.885012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:15.885012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:15.885012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:15.885012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:15.885012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:15.885012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 268/524] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:15.885012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95d9b-a53e-4435-bdf2-9854314c1b2c None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:15.985892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d5d1f-8400-4253-b806-f8f9f78330ab None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:15.992911 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95d9b-a53e-4435-bdf2-9854314c1b2c None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:16.027508 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc13946-62be-49fa-bbc4-b8e2f2084368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:16.028438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc13946-62be-49fa-bbc4-b8e2f2084368 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:16.029035 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc13946-62be-49fa-bbc4-b8e2f2084368 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:16.029485 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc13946-62be-49fa-bbc4-b8e2f2084368 None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:16.030397 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc13946-62be-49fa-bbc4-b8e2f2084368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:16.030892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc13946-62be-49fa-bbc4-b8e2f2084368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:16.031100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a703-b990-46d0-a111-553ba4adcc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:16.031871 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a703-b990-46d0-a111-553ba4adcc49 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:16.032204 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a703-b990-46d0-a111-553ba4adcc49 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:16.032605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a703-b990-46d0-a111-553ba4adcc49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:16.034144 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc13946-62be-49fa-bbc4-b8e2f2084368 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:16.037217 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:16.041896 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131a703-b990-46d0-a111-553ba4adcc49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:16.043688 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131a703-b990-46d0-a111-553ba4adcc49 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-1131a703-b990-46d0-a111-553ba4adcc49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:16.058507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:16.059386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:16.065544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:16.065544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:16.065544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:16.065544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:16.065544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:16.065544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:16.065544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:16.065544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:16.065544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 269/525] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:16.065544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a703-b990-46d0-a111-553ba4adcc49 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:16.066108 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 257/526] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:16.066108 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc13946-62be-49fa-bbc4-b8e2f2084368 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:16.078967 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:16.186016 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc13946-62be-49fa-bbc4-b8e2f2084368 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:16.188518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a703-b990-46d0-a111-553ba4adcc49 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:16.227468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01956c34-ef86-4bcb-811b-9528050b5eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:16.228208 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01956c34-ef86-4bcb-811b-9528050b5eb4 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:16.229032 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01956c34-ef86-4bcb-811b-9528050b5eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:16.229275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d84dc-3e55-480e-be92-a039a969413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:16.229410 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01956c34-ef86-4bcb-811b-9528050b5eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:16.230001 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d84dc-3e55-480e-be92-a039a969413b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:16.230100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01956c34-ef86-4bcb-811b-9528050b5eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:16.230325 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01956c34-ef86-4bcb-811b-9528050b5eb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:16.230429 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d84dc-3e55-480e-be92-a039a969413b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:16.230844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d84dc-3e55-480e-be92-a039a969413b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:16.231731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d84dc-3e55-480e-be92-a039a969413b None admin] RBAC: Adding query filter params (role.id=a0c07ffc05d54106b2f356d6f76ae54b, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=8fcc9424a8984a3db449c23bb5908eb2) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:16.231836 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01956c34-ef86-4bcb-811b-9528050b5eb4 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:16.232047 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d84dc-3e55-480e-be92-a039a969413b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:16.233769 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d84dc-3e55-480e-be92-a039a969413b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:16.246100 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 258/527] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:39:16 2022] GET /identity/v3/role_assignments?user.id=8fcc9424a8984a3db449c23bb5908eb2&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=a0c07ffc05d54106b2f356d6f76ae54b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:16.246100 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d84dc-3e55-480e-be92-a039a969413b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:16.258103 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 270/528] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:16.267003 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01956c34-ef86-4bcb-811b-9528050b5eb4 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:16.332392 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:16.375119 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:16.399895 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d84dc-3e55-480e-be92-a039a969413b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:16.426827 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01956c34-ef86-4bcb-811b-9528050b5eb4 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:16.447495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4357d66-6ee9-4e08-97a8-74f04aa9c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:16.448442 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357d66-6ee9-4e08-97a8-74f04aa9c70a None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:16.449022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357d66-6ee9-4e08-97a8-74f04aa9c70a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:16.449447 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357d66-6ee9-4e08-97a8-74f04aa9c70a None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:16.450420 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4357d66-6ee9-4e08-97a8-74f04aa9c70a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:16.450914 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4357d66-6ee9-4e08-97a8-74f04aa9c70a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:16.452509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4357d66-6ee9-4e08-97a8-74f04aa9c70a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:16.468437 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 259/529] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:16.470209 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f2a27-2e9c-44f7-b7ac-ed0e277f09d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:16.471005 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f2a27-2e9c-44f7-b7ac-ed0e277f09d2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:16.471279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f2a27-2e9c-44f7-b7ac-ed0e277f09d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:16.471549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f2a27-2e9c-44f7-b7ac-ed0e277f09d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:16.472295 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f2a27-2e9c-44f7-b7ac-ed0e277f09d2 None admin] RBAC: Adding query filter params (role.id=a0c07ffc05d54106b2f356d6f76ae54b, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=e541d55268064ad986a5d05108120f62) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:16.472604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f2a27-2e9c-44f7-b7ac-ed0e277f09d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:16.474138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4357d66-6ee9-4e08-97a8-74f04aa9c70a None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:16.475583 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f2a27-2e9c-44f7-b7ac-ed0e277f09d2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:16.487920 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 271/530] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:39:16 2022] GET /identity/v3/role_assignments?user.id=e541d55268064ad986a5d05108120f62&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=a0c07ffc05d54106b2f356d6f76ae54b => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:16.592479 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4357d66-6ee9-4e08-97a8-74f04aa9c70a None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:16.612602 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:16.631276 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf14f16-4492-4111-8f39-816f7ab55d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:16.631899 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf14f16-4492-4111-8f39-816f7ab55d4f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:16.632176 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf14f16-4492-4111-8f39-816f7ab55d4f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:16.632451 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf14f16-4492-4111-8f39-816f7ab55d4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:16.633187 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf14f16-4492-4111-8f39-816f7ab55d4f None admin] RBAC: Adding query filter params (role.id=a0c07ffc05d54106b2f356d6f76ae54b, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=ff8273f4715e4f8ca50106a9abf7781b) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:16.633494 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf14f16-4492-4111-8f39-816f7ab55d4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:16.635129 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf14f16-4492-4111-8f39-816f7ab55d4f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:16.642092 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 260/531] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:39:16 2022] GET /identity/v3/role_assignments?user.id=ff8273f4715e4f8ca50106a9abf7781b&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=a0c07ffc05d54106b2f356d6f76ae54b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:17.441326 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52ab7c-c420-45f8-915b-c1d2f4a949ca None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:17.441847 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52ab7c-c420-45f8-915b-c1d2f4a949ca None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:17.441847 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52ab7c-c420-45f8-915b-c1d2f4a949ca None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:17.443348 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 272/532] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:17.449393 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b4842-d2f2-4f3d-bd7b-c8fabbafa3d0 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:17.449861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b4842-d2f2-4f3d-bd7b-c8fabbafa3d0 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:17.450088 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b4842-d2f2-4f3d-bd7b-c8fabbafa3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:17.469610 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-c15b4842-d2f2-4f3d-bd7b-c8fabbafa3d0 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:17.471164 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c15b4842-d2f2-4f3d-bd7b-c8fabbafa3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:17.540633 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 261/533] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:17.874251 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52ab7c-c420-45f8-915b-c1d2f4a949ca None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:17.985450 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52ab7c-c420-45f8-915b-c1d2f4a949ca None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:18.018151 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:18.024183 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b383e9-5d85-4e82-a3f1-3a3dc5e8d807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:18.025283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b383e9-5d85-4e82-a3f1-3a3dc5e8d807 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.025793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b383e9-5d85-4e82-a3f1-3a3dc5e8d807 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.026307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b383e9-5d85-4e82-a3f1-3a3dc5e8d807 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.038045 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b383e9-5d85-4e82-a3f1-3a3dc5e8d807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-c0b383e9-5d85-4e82-a3f1-3a3dc5e8d807 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:18.044057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:18.044989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:18.045771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:18.048453 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 273/534] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:18.054515 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b4842-d2f2-4f3d-bd7b-c8fabbafa3d0 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:18.159324 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b4842-d2f2-4f3d-bd7b-c8fabbafa3d0 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:18.173552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:18.195736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0fcd-040b-4a40-9278-77dac9cfeecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:18.196405 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0fcd-040b-4a40-9278-77dac9cfeecf None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.196683 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0fcd-040b-4a40-9278-77dac9cfeecf None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.197118 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0fcd-040b-4a40-9278-77dac9cfeecf None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.197805 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0fcd-040b-4a40-9278-77dac9cfeecf None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:18.198147 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0fcd-040b-4a40-9278-77dac9cfeecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:18.199577 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0fcd-040b-4a40-9278-77dac9cfeecf None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:18.208576 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 262/535] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:18.214306 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b383e9-5d85-4e82-a3f1-3a3dc5e8d807 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:18.331726 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b383e9-5d85-4e82-a3f1-3a3dc5e8d807 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:18.369862 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c05eaa-cf03-4894-9414-77e5b0937a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:18.370536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c05eaa-cf03-4894-9414-77e5b0937a68 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.370808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c05eaa-cf03-4894-9414-77e5b0937a68 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.371072 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c05eaa-cf03-4894-9414-77e5b0937a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.382476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c05eaa-cf03-4894-9414-77e5b0937a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:18.384017 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c05eaa-cf03-4894-9414-77e5b0937a68 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-09c05eaa-cf03-4894-9414-77e5b0937a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:18.399707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:18.400864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:18.401703 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:18.401703 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:18.401703 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:18.402370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 274/536] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:18.407425 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0fcd-040b-4a40-9278-77dac9cfeecf None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:18.533824 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0fcd-040b-4a40-9278-77dac9cfeecf None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:18.569112 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efb67d-8f48-4e8c-8a25-723f813c6ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:18.569727 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb67d-8f48-4e8c-8a25-723f813c6ef0 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.570026 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb67d-8f48-4e8c-8a25-723f813c6ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.570296 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb67d-8f48-4e8c-8a25-723f813c6ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.570937 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efb67d-8f48-4e8c-8a25-723f813c6ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:18.571232 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efb67d-8f48-4e8c-8a25-723f813c6ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:18.572625 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efb67d-8f48-4e8c-8a25-723f813c6ef0 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:18.585942 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 263/537] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:18.591313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c05eaa-cf03-4894-9414-77e5b0937a68 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:18.640650 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b96e-a9d2-4f90-a92c-72fdf85e7104 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.640962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b96e-a9d2-4f90-a92c-72fdf85e7104 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.641196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b96e-a9d2-4f90-a92c-72fdf85e7104 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.643031 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 264/538] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:18.643746 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:18.650299 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22172b0-4142-4a2b-9a73-2db7b1e6a234 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.650643 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22172b0-4142-4a2b-9a73-2db7b1e6a234 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.650839 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22172b0-4142-4a2b-9a73-2db7b1e6a234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.677073 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-f22172b0-4142-4a2b-9a73-2db7b1e6a234 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:18.678644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-f22172b0-4142-4a2b-9a73-2db7b1e6a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:18.718025 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c05eaa-cf03-4894-9414-77e5b0937a68 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:18.730141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:18.758705 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc7953-5347-4ac4-a7b1-0f0b505cb42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:18.760184 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7953-5347-4ac4-a7b1-0f0b505cb42d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.760724 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7953-5347-4ac4-a7b1-0f0b505cb42d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.761190 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7953-5347-4ac4-a7b1-0f0b505cb42d None admin] PATH_INFO: `/v3/users/nova` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.777947 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 265/539] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:18.778179 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc7953-5347-4ac4-a7b1-0f0b505cb42d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:18.778179 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc7953-5347-4ac4-a7b1-0f0b505cb42d None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-54fc7953-5347-4ac4-a7b1-0f0b505cb42d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:18.791518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:18.792722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:18.793818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:18.793818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:18.793818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:18.793818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:18.793818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:18.793818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:18.793818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:18.793818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:18.793818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:18.793818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:18.795543 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 275/540] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 14:39:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:18.801595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22172b0-4142-4a2b-9a73-2db7b1e6a234 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:18.811311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86dd6d-9811-43bb-8be5-e8b2bc4d247d None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.813714 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86dd6d-9811-43bb-8be5-e8b2bc4d247d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.815686 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86dd6d-9811-43bb-8be5-e8b2bc4d247d None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.816915 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 276/541] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:18.822977 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444613-323c-469e-8b1e-d551de826473 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.823378 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444613-323c-469e-8b1e-d551de826473 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.823748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444613-323c-469e-8b1e-d551de826473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.851868 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-9e444613-323c-469e-8b1e-d551de826473 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:18.859865 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-9e444613-323c-469e-8b1e-d551de826473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:18.945939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22172b0-4142-4a2b-9a73-2db7b1e6a234 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:18.972970 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 277/542] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:18.974706 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef441ec-3c07-41f6-ad9f-a895538f0b0e None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.975023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef441ec-3c07-41f6-ad9f-a895538f0b0e None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.977976 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef441ec-3c07-41f6-ad9f-a895538f0b0e None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.977976 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 278/543] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:18.983682 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff33f3a-8774-447f-a6a6-624483c67f6b None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.984439 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff33f3a-8774-447f-a6a6-624483c67f6b None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.985075 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff33f3a-8774-447f-a6a6-624483c67f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.989018 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8afad-f4da-41f9-b429-42ba09c4a566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:18.997958 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8afad-f4da-41f9-b429-42ba09c4a566 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:18.997958 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8afad-f4da-41f9-b429-42ba09c4a566 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:18.997958 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8afad-f4da-41f9-b429-42ba09c4a566 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:18.997958 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8afad-f4da-41f9-b429-42ba09c4a566 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:18.997958 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8afad-f4da-41f9-b429-42ba09c4a566 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:18.997958 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8afad-f4da-41f9-b429-42ba09c4a566 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:19.032550 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-9ff33f3a-8774-447f-a6a6-624483c67f6b None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:19.033076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 266/544] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 14:39:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:19.034478 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-9ff33f3a-8774-447f-a6a6-624483c67f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:19.038737 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8afad-f4da-41f9-b429-42ba09c4a566 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:19.082459 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:19.097994 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:19.166101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 279/545] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:19.167369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff33f3a-8774-447f-a6a6-624483c67f6b None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:19.182132 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8afad-f4da-41f9-b429-42ba09c4a566 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:19.224334 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384f117-8dc9-4394-b442-eac17808fb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:19.225640 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384f117-8dc9-4394-b442-eac17808fb77 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:19.226149 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384f117-8dc9-4394-b442-eac17808fb77 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:19.226612 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384f117-8dc9-4394-b442-eac17808fb77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:19.238313 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384f117-8dc9-4394-b442-eac17808fb77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:19.240117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384f117-8dc9-4394-b442-eac17808fb77 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-6384f117-8dc9-4394-b442-eac17808fb77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:19.257174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:19.258379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:19.259266 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:19.259266 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:19.259266 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:19.261480 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 267/546] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:19.269957 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384f117-8dc9-4394-b442-eac17808fb77 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:19.308335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff33f3a-8774-447f-a6a6-624483c67f6b None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:19.350848 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:19.360760 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b599d3-51af-490e-a52e-2d108bef01a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:19.361698 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b599d3-51af-490e-a52e-2d108bef01a1 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:19.362020 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b599d3-51af-490e-a52e-2d108bef01a1 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:19.362297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b599d3-51af-490e-a52e-2d108bef01a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:19.373614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b599d3-51af-490e-a52e-2d108bef01a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-c6b599d3-51af-490e-a52e-2d108bef01a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:19.378625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:19.379524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:19.380300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 280/547] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:19.380965 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b599d3-51af-490e-a52e-2d108bef01a1 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:19.389118 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384f117-8dc9-4394-b442-eac17808fb77 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:19.413375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:19.427625 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517b656-8025-4704-95e7-c5fcd167ae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:19.428261 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517b656-8025-4704-95e7-c5fcd167ae82 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:19.428536 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517b656-8025-4704-95e7-c5fcd167ae82 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:19.428831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517b656-8025-4704-95e7-c5fcd167ae82 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:19.429504 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517b656-8025-4704-95e7-c5fcd167ae82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:19.429808 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517b656-8025-4704-95e7-c5fcd167ae82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:19.431332 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517b656-8025-4704-95e7-c5fcd167ae82 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:19.444972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 268/548] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:19.445950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517b656-8025-4704-95e7-c5fcd167ae82 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:19.496428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b599d3-51af-490e-a52e-2d108bef01a1 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:19.531371 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7c432-8248-4d0b-bacd-7d362e4c493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:19.531986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7c432-8248-4d0b-bacd-7d362e4c493e None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:19.532249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7c432-8248-4d0b-bacd-7d362e4c493e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:19.532521 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7c432-8248-4d0b-bacd-7d362e4c493e None admin] PATH_INFO: `/v3/roles/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:19.542924 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7c432-8248-4d0b-bacd-7d362e4c493e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-29a7c432-8248-4d0b-bacd-7d362e4c493e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:19.547636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:19.548546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:19.549362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 281/549] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:19.550225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7c432-8248-4d0b-bacd-7d362e4c493e None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:19.557865 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517b656-8025-4704-95e7-c5fcd167ae82 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:19.595932 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab43f03-bcd2-4dc7-bdc9-943d320415d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:19.596551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab43f03-bcd2-4dc7-bdc9-943d320415d9 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:19.596811 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab43f03-bcd2-4dc7-bdc9-943d320415d9 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:19.597070 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab43f03-bcd2-4dc7-bdc9-943d320415d9 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:19.597792 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab43f03-bcd2-4dc7-bdc9-943d320415d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:19.598151 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab43f03-bcd2-4dc7-bdc9-943d320415d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:19.599640 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab43f03-bcd2-4dc7-bdc9-943d320415d9 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:19.601096 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:19.608847 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 269/550] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:19.609639 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab43f03-bcd2-4dc7-bdc9-943d320415d9 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:19.642414 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:19.657293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7c432-8248-4d0b-bacd-7d362e4c493e None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:19.694556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30920290-84fe-4fe3-8790-5dbf4252f150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:19.695213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30920290-84fe-4fe3-8790-5dbf4252f150 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:19.695477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30920290-84fe-4fe3-8790-5dbf4252f150 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:19.695743 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30920290-84fe-4fe3-8790-5dbf4252f150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:19.708337 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30920290-84fe-4fe3-8790-5dbf4252f150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:19.709818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30920290-84fe-4fe3-8790-5dbf4252f150 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:19.716253 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab43f03-bcd2-4dc7-bdc9-943d320415d9 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-30920290-84fe-4fe3-8790-5dbf4252f150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:19.722842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:19.723753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:19.725080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:19.725080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:19.725080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:19.725080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:19.725080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:19.725080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:19.725080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:19.725080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:19.725080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 282/551] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:19.725080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30920290-84fe-4fe3-8790-5dbf4252f150 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:19.764034 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f528f-386f-41bb-b0af-c7e04b722d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:19.764679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f528f-386f-41bb-b0af-c7e04b722d9e None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:19.764950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f528f-386f-41bb-b0af-c7e04b722d9e None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:19.765215 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f528f-386f-41bb-b0af-c7e04b722d9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:19.776291 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f528f-386f-41bb-b0af-c7e04b722d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-e73f528f-386f-41bb-b0af-c7e04b722d9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:19.781431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:19.782441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:19.783270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 270/552] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:19.783935 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f528f-386f-41bb-b0af-c7e04b722d9e None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:19.855164 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:19.860530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30920290-84fe-4fe3-8790-5dbf4252f150 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:19.898220 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e069449-f3d0-4f20-bd1f-6b39f223da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:19.898859 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069449-f3d0-4f20-bd1f-6b39f223da5a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:19.899133 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069449-f3d0-4f20-bd1f-6b39f223da5a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:19.899400 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069449-f3d0-4f20-bd1f-6b39f223da5a None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:19.900510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e069449-f3d0-4f20-bd1f-6b39f223da5a None admin] RBAC: Adding query filter params (name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:19.900510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e069449-f3d0-4f20-bd1f-6b39f223da5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:19.900703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f528f-386f-41bb-b0af-c7e04b722d9e None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:19.901898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e069449-f3d0-4f20-bd1f-6b39f223da5a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:19.910465 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 283/553] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:19.911276 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e069449-f3d0-4f20-bd1f-6b39f223da5a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:19.921257 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:19.940958 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9294d3c-ec1e-4110-9db7-4524af2ffb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:19.941623 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9294d3c-ec1e-4110-9db7-4524af2ffb33 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:19.942022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9294d3c-ec1e-4110-9db7-4524af2ffb33 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:19.942253 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9294d3c-ec1e-4110-9db7-4524af2ffb33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:19.952740 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9294d3c-ec1e-4110-9db7-4524af2ffb33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:19.954247 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9294d3c-ec1e-4110-9db7-4524af2ffb33 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-a9294d3c-ec1e-4110-9db7-4524af2ffb33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:19.969159 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:19.970166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:19.971020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:19.971020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:19.971020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:19.971020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 271/554] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:19.971286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9294d3c-ec1e-4110-9db7-4524af2ffb33 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.019924 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e069449-f3d0-4f20-bd1f-6b39f223da5a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.054337 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04796c-39c7-4e9d-91d6-f5a5584fa9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:20.054957 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04796c-39c7-4e9d-91d6-f5a5584fa9d2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:20.055235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04796c-39c7-4e9d-91d6-f5a5584fa9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:20.055506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04796c-39c7-4e9d-91d6-f5a5584fa9d2 None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:20.056356 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04796c-39c7-4e9d-91d6-f5a5584fa9d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:20.057026 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04796c-39c7-4e9d-91d6-f5a5584fa9d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:20.058141 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04796c-39c7-4e9d-91d6-f5a5584fa9d2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:20.070633 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 284/555] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:20.071461 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04796c-39c7-4e9d-91d6-f5a5584fa9d2 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.073774 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9294d3c-ec1e-4110-9db7-4524af2ffb33 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.083305 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:20.109197 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a8c9-73e0-4cc1-9f6f-cfe84d6fc885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:20.109716 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a8c9-73e0-4cc1-9f6f-cfe84d6fc885 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:20.110022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a8c9-73e0-4cc1-9f6f-cfe84d6fc885 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:20.110305 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a8c9-73e0-4cc1-9f6f-cfe84d6fc885 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:20.110952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a8c9-73e0-4cc1-9f6f-cfe84d6fc885 None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:20.111261 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a8c9-73e0-4cc1-9f6f-cfe84d6fc885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:20.112615 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a8c9-73e0-4cc1-9f6f-cfe84d6fc885 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:20.121211 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 272/556] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:20.122063 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a8c9-73e0-4cc1-9f6f-cfe84d6fc885 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.146495 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:20.181927 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04796c-39c7-4e9d-91d6-f5a5584fa9d2 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.219167 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6418e-45ea-4668-b99c-e1647183894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:20.219832 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6418e-45ea-4668-b99c-e1647183894a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:20.220159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6418e-45ea-4668-b99c-e1647183894a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:20.220432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6418e-45ea-4668-b99c-e1647183894a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:20.231402 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6418e-45ea-4668-b99c-e1647183894a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:20.232892 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6418e-45ea-4668-b99c-e1647183894a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:20.235450 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a8c9-73e0-4cc1-9f6f-cfe84d6fc885 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-d6d6418e-45ea-4668-b99c-e1647183894a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:20.247687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:20.248740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:20.249595 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:20.249595 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:20.249595 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:20.249595 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 285/557] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:20.249595 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6418e-45ea-4668-b99c-e1647183894a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.276371 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2d1d6-6133-4d1d-8322-e6aab189e87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:20.276991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2d1d6-6133-4d1d-8322-e6aab189e87a None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:20.277266 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2d1d6-6133-4d1d-8322-e6aab189e87a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:20.277542 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2d1d6-6133-4d1d-8322-e6aab189e87a None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:20.278226 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2d1d6-6133-4d1d-8322-e6aab189e87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:20.278530 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2d1d6-6133-4d1d-8322-e6aab189e87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:20.279900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2d1d6-6133-4d1d-8322-e6aab189e87a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:20.292238 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 273/558] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:20.292851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2d1d6-6133-4d1d-8322-e6aab189e87a None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.325538 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:20.368169 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6418e-45ea-4668-b99c-e1647183894a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.388884 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:20.407348 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc02f01-4f7c-4e61-850e-8515f516126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:20.407948 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2d1d6-6133-4d1d-8322-e6aab189e87a None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.408104 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc02f01-4f7c-4e61-850e-8515f516126a None admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:20.408443 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc02f01-4f7c-4e61-850e-8515f516126a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:20.408675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc02f01-4f7c-4e61-850e-8515f516126a None admin] PATH_INFO: `/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/c1a9ed9280d249f9a76d037ff8407082/roles/a0c07ffc05d54106b2f356d6f76ae54b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:20.425275 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc02f01-4f7c-4e61-850e-8515f516126a None admin] RBAC: Authorizing `identity:create_grant(project_id=715f57a8ea67473baf35f0bc91c0ffdb, user_id=c1a9ed9280d249f9a76d037ff8407082, role_id=a0c07ffc05d54106b2f356d6f76ae54b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:20.426765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc02f01-4f7c-4e61-850e-8515f516126a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:20.442301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 286/559] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:39:20 2022] PUT /identity/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/c1a9ed9280d249f9a76d037ff8407082/roles/a0c07ffc05d54106b2f356d6f76ae54b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:39:20.443122 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc02f01-4f7c-4e61-850e-8515f516126a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.448038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaf8b8-ae3b-4a3e-88d7-fa8fa6bdec2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:20.448731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf8b8-ae3b-4a3e-88d7-fa8fa6bdec2e None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:20.449029 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf8b8-ae3b-4a3e-88d7-fa8fa6bdec2e None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:20.449517 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf8b8-ae3b-4a3e-88d7-fa8fa6bdec2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:20.464309 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaf8b8-ae3b-4a3e-88d7-fa8fa6bdec2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:20.465879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaf8b8-ae3b-4a3e-88d7-fa8fa6bdec2e None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-7ccaf8b8-ae3b-4a3e-88d7-fa8fa6bdec2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:20.484133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:20.485320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:20.486675 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:20.486675 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:20.486675 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:20.486675 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 274/560] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:20.486909 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaf8b8-ae3b-4a3e-88d7-fa8fa6bdec2e None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.573191 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc02f01-4f7c-4e61-850e-8515f516126a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.582581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:20.608077 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaf8b8-ae3b-4a3e-88d7-fa8fa6bdec2e None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.622337 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b81de4-ce61-4065-b941-5e47ffd321fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:20.622922 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b81de4-ce61-4065-b941-5e47ffd321fb None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:20.623858 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b81de4-ce61-4065-b941-5e47ffd321fb None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:20.624123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b81de4-ce61-4065-b941-5e47ffd321fb None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:20.625574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b81de4-ce61-4065-b941-5e47ffd321fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:20.625882 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b81de4-ce61-4065-b941-5e47ffd321fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:20.627401 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b81de4-ce61-4065-b941-5e47ffd321fb None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:20.643655 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 287/561] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:20.644705 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b81de4-ce61-4065-b941-5e47ffd321fb None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.650008 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2d701-6ed5-4524-a6a4-d2e6222ee6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:20.651109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2d701-6ed5-4524-a6a4-d2e6222ee6f4 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:20.651394 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2d701-6ed5-4524-a6a4-d2e6222ee6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:20.651737 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2d701-6ed5-4524-a6a4-d2e6222ee6f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:20.660153 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2d701-6ed5-4524-a6a4-d2e6222ee6f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:20.661598 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2d701-6ed5-4524-a6a4-d2e6222ee6f4 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-b2f2d701-6ed5-4524-a6a4-d2e6222ee6f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:20.674519 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:20.676087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 275/562] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:20.677954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2d701-6ed5-4524-a6a4-d2e6222ee6f4 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.683111 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:20.767440 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b81de4-ce61-4065-b941-5e47ffd321fb None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.795427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2d701-6ed5-4524-a6a4-d2e6222ee6f4 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.805064 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a4ce1-2dcd-4b7e-a44e-78c9c7eedbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:20.806240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a4ce1-2dcd-4b7e-a44e-78c9c7eedbed None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:20.806544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a4ce1-2dcd-4b7e-a44e-78c9c7eedbed None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:20.806819 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a4ce1-2dcd-4b7e-a44e-78c9c7eedbed None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:20.807762 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a4ce1-2dcd-4b7e-a44e-78c9c7eedbed None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:20.808381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a4ce1-2dcd-4b7e-a44e-78c9c7eedbed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:20.810045 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a4ce1-2dcd-4b7e-a44e-78c9c7eedbed None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:20.824419 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 288/563] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:20.825274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a4ce1-2dcd-4b7e-a44e-78c9c7eedbed None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.837602 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874d5c-523b-4db0-99a3-666dc77ca88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:20.838670 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874d5c-523b-4db0-99a3-666dc77ca88f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:20.838951 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874d5c-523b-4db0-99a3-666dc77ca88f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:20.839223 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874d5c-523b-4db0-99a3-666dc77ca88f None admin] PATH_INFO: `/v3/users/glance` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:20.847564 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874d5c-523b-4db0-99a3-666dc77ca88f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:20.849575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874d5c-523b-4db0-99a3-666dc77ca88f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-47874d5c-523b-4db0-99a3-666dc77ca88f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:20.861823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:20.863045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 276/564] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:20.864138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874d5c-523b-4db0-99a3-666dc77ca88f None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:20.867451 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:20.948695 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:20.963094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a4ce1-2dcd-4b7e-a44e-78c9c7eedbed None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:20.995348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874d5c-523b-4db0-99a3-666dc77ca88f None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:21.002513 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bebc8-25d5-4741-be3a-8c89cd731abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:21.003472 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bebc8-25d5-4741-be3a-8c89cd731abd None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:21.003750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bebc8-25d5-4741-be3a-8c89cd731abd None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:21.004022 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bebc8-25d5-4741-be3a-8c89cd731abd None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:21.004818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bebc8-25d5-4741-be3a-8c89cd731abd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:21.005057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bebc8-25d5-4741-be3a-8c89cd731abd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:21.006819 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bebc8-25d5-4741-be3a-8c89cd731abd None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:21.030494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 289/565] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 14:39:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:21.030494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bebc8-25d5-4741-be3a-8c89cd731abd None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:21.040146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496327-569a-4176-ad71-9cc0d2ae1196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:21.041433 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496327-569a-4176-ad71-9cc0d2ae1196 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:21.041715 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496327-569a-4176-ad71-9cc0d2ae1196 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:21.042010 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496327-569a-4176-ad71-9cc0d2ae1196 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:21.051341 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5496327-569a-4176-ad71-9cc0d2ae1196 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:21.053181 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5496327-569a-4176-ad71-9cc0d2ae1196 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-f5496327-569a-4176-ad71-9cc0d2ae1196 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:21.066322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:21.067285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:21.068202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:21.068202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:21.068202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:21.068202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:21.068202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:21.068202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:21.068202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:21.068202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:21.068202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 14:39:21.068202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:21.072769 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 277/566] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:21.073457 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496327-569a-4176-ad71-9cc0d2ae1196 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:21.143509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:21.152787 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bebc8-25d5-4741-be3a-8c89cd731abd None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:21.186287 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496327-569a-4176-ad71-9cc0d2ae1196 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:21.190859 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c3c27-966c-4ad3-a725-d7f77fe3b949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:21.191510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3c27-966c-4ad3-a725-d7f77fe3b949 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:21.191783 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3c27-966c-4ad3-a725-d7f77fe3b949 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:21.192045 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3c27-966c-4ad3-a725-d7f77fe3b949 None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:21.192797 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c3c27-966c-4ad3-a725-d7f77fe3b949 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:21.193096 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c3c27-966c-4ad3-a725-d7f77fe3b949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:21.194575 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c3c27-966c-4ad3-a725-d7f77fe3b949 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:21.214283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 290/567] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 14:39:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:21.215096 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c3c27-966c-4ad3-a725-d7f77fe3b949 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:21.220110 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:21.234138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67bc73-dab2-4de9-96ee-767b82f15e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:21.234926 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67bc73-dab2-4de9-96ee-767b82f15e79 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:21.235200 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67bc73-dab2-4de9-96ee-767b82f15e79 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:21.235467 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67bc73-dab2-4de9-96ee-767b82f15e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:21.247022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67bc73-dab2-4de9-96ee-767b82f15e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:21.248571 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67bc73-dab2-4de9-96ee-767b82f15e79 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-ff67bc73-dab2-4de9-96ee-767b82f15e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:21.263228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:21.264189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:21.265119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:21.265119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:21.265119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:21.265119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 278/568] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:21.265119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67bc73-dab2-4de9-96ee-767b82f15e79 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:21.329725 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c3c27-966c-4ad3-a725-d7f77fe3b949 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:21.372911 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67bc73-dab2-4de9-96ee-767b82f15e79 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:21.374622 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e23fc-d227-4173-85c1-78b007c6fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:21.375243 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e23fc-d227-4173-85c1-78b007c6fcff None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:21.375515 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e23fc-d227-4173-85c1-78b007c6fcff None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:21.376032 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e23fc-d227-4173-85c1-78b007c6fcff None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:21.376828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e23fc-d227-4173-85c1-78b007c6fcff None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:21.377284 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e23fc-d227-4173-85c1-78b007c6fcff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:21.379187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e23fc-d227-4173-85c1-78b007c6fcff None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:21.398669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 291/569] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Aug 19 14:39:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:21.399519 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e23fc-d227-4173-85c1-78b007c6fcff None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:21.407792 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:21.433872 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587ed4a-fbc1-4954-bf72-b6c965d63728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:21.434581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587ed4a-fbc1-4954-bf72-b6c965d63728 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:21.434857 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587ed4a-fbc1-4954-bf72-b6c965d63728 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:21.435124 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587ed4a-fbc1-4954-bf72-b6c965d63728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:21.447652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587ed4a-fbc1-4954-bf72-b6c965d63728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:21.449371 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587ed4a-fbc1-4954-bf72-b6c965d63728 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:21.467490 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-6587ed4a-fbc1-4954-bf72-b6c965d63728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:21.470462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:21.471432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:21.472314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:21.472314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:21.472314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:21.480268 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 279/570] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:21.480268 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587ed4a-fbc1-4954-bf72-b6c965d63728 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:21.524138 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e23fc-d227-4173-85c1-78b007c6fcff None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:21.574646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39546db1-b501-4890-96d0-27caade398ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:21.575412 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546db1-b501-4890-96d0-27caade398ad None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:21.575754 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546db1-b501-4890-96d0-27caade398ad None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:21.576085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546db1-b501-4890-96d0-27caade398ad None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:21.576806 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39546db1-b501-4890-96d0-27caade398ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:21.577178 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39546db1-b501-4890-96d0-27caade398ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:21.579271 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39546db1-b501-4890-96d0-27caade398ad None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:21.600082 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 292/571] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:21.600082 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39546db1-b501-4890-96d0-27caade398ad None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:21.607509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587ed4a-fbc1-4954-bf72-b6c965d63728 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:21.652137 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024564ca-5b9f-43db-9196-94e2572fe204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:21.653759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024564ca-5b9f-43db-9196-94e2572fe204 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:21.654348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024564ca-5b9f-43db-9196-94e2572fe204 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:21.654680 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024564ca-5b9f-43db-9196-94e2572fe204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:21.669779 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024564ca-5b9f-43db-9196-94e2572fe204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:21.672935 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024564ca-5b9f-43db-9196-94e2572fe204 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-024564ca-5b9f-43db-9196-94e2572fe204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:21.692840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:21.694091 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:21.695204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:21.695204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:21.695204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:21.695921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 280/572] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:21.697096 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024564ca-5b9f-43db-9196-94e2572fe204 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:21.719860 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:21.759331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39546db1-b501-4890-96d0-27caade398ad None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:21.794460 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:21.810299 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586dc5c-33aa-4e0b-bcfb-625bb05e3076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:21.810916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586dc5c-33aa-4e0b-bcfb-625bb05e3076 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:21.811189 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586dc5c-33aa-4e0b-bcfb-625bb05e3076 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:21.811452 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586dc5c-33aa-4e0b-bcfb-625bb05e3076 None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:21.812119 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586dc5c-33aa-4e0b-bcfb-625bb05e3076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:21.812414 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586dc5c-33aa-4e0b-bcfb-625bb05e3076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:21.813835 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586dc5c-33aa-4e0b-bcfb-625bb05e3076 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:21.839934 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024564ca-5b9f-43db-9196-94e2572fe204 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:21.840146 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 293/573] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:21.840146 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586dc5c-33aa-4e0b-bcfb-625bb05e3076 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:21.897247 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4103-2f2e-4633-be78-0b0aa6bcc3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:21.897888 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4103-2f2e-4633-be78-0b0aa6bcc3df None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:21.898202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4103-2f2e-4633-be78-0b0aa6bcc3df None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:21.898529 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4103-2f2e-4633-be78-0b0aa6bcc3df None admin] PATH_INFO: `/v3/projects/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:21.906676 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c4103-2f2e-4633-be78-0b0aa6bcc3df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:21.908147 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c4103-2f2e-4633-be78-0b0aa6bcc3df None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-ea2c4103-2f2e-4633-be78-0b0aa6bcc3df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:21.922427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:21.923871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:21.924966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:21.924966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:21.924966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:21.924966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:21.924966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:21.924966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:21.924966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:21.924966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:21.928636 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 281/574] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:21.929633 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4103-2f2e-4633-be78-0b0aa6bcc3df None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:21.984986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586dc5c-33aa-4e0b-bcfb-625bb05e3076 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:22.036446 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec51e00-51cb-495f-9369-1b41fa5333aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:22.037366 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51e00-51cb-495f-9369-1b41fa5333aa None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.037866 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51e00-51cb-495f-9369-1b41fa5333aa None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.038142 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51e00-51cb-495f-9369-1b41fa5333aa None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:22.038980 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec51e00-51cb-495f-9369-1b41fa5333aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:22.039282 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec51e00-51cb-495f-9369-1b41fa5333aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:22.040784 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec51e00-51cb-495f-9369-1b41fa5333aa None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:22.046167 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:22.063011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 294/575] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:22.070473 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec51e00-51cb-495f-9369-1b41fa5333aa None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:22.081887 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4103-2f2e-4633-be78-0b0aa6bcc3df None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:22.120465 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8f6a-8a3f-4b57-a259-2614de152cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:22.121109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8f6a-8a3f-4b57-a259-2614de152cfd None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.121427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8f6a-8a3f-4b57-a259-2614de152cfd None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.121695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8f6a-8a3f-4b57-a259-2614de152cfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:22.129297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:22.129648 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd8f6a-8a3f-4b57-a259-2614de152cfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:22.131658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd8f6a-8a3f-4b57-a259-2614de152cfd None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-e3bd8f6a-8a3f-4b57-a259-2614de152cfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:22.151581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:22.152679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:22.153677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:22.153677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:22.153677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:22.153677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:22.153677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:22.153677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:22.153677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:22.153677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:22.153677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 282/576] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:22.154391 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8f6a-8a3f-4b57-a259-2614de152cfd None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:22.223591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec51e00-51cb-495f-9369-1b41fa5333aa None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:22.266694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6694707-320a-4e8b-9e6b-916ea4a26947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:22.267308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6694707-320a-4e8b-9e6b-916ea4a26947 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.267572 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6694707-320a-4e8b-9e6b-916ea4a26947 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.267840 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6694707-320a-4e8b-9e6b-916ea4a26947 None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:22.268536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6694707-320a-4e8b-9e6b-916ea4a26947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:22.268827 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6694707-320a-4e8b-9e6b-916ea4a26947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:22.270327 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6694707-320a-4e8b-9e6b-916ea4a26947 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:22.283839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 295/577] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:22.284570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6694707-320a-4e8b-9e6b-916ea4a26947 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:22.300889 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8f6a-8a3f-4b57-a259-2614de152cfd None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:22.358784 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad49ae-bc26-4479-836d-3b7ee232a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:22.359814 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad49ae-bc26-4479-836d-3b7ee232a620 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.360306 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad49ae-bc26-4479-836d-3b7ee232a620 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.360691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad49ae-bc26-4479-836d-3b7ee232a620 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:22.374497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad49ae-bc26-4479-836d-3b7ee232a620 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:22.376460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad49ae-bc26-4479-836d-3b7ee232a620 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:22.378791 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-85ad49ae-bc26-4479-836d-3b7ee232a620 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:22.395191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:22.402376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:22.403575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:22.403575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:22.403575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:22.403575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:22.403575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:22.403575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:22.403575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:22.403575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:22.403575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 283/578] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:22.403575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad49ae-bc26-4479-836d-3b7ee232a620 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:22.458917 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6694707-320a-4e8b-9e6b-916ea4a26947 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:22.463705 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:22.515047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c7793-185b-432a-add7-7ed969b6b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:22.515509 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c7793-185b-432a-add7-7ed969b6b987 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.515773 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c7793-185b-432a-add7-7ed969b6b987 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.518406 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c7793-185b-432a-add7-7ed969b6b987 None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:22.520038 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c7793-185b-432a-add7-7ed969b6b987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:22.520508 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c7793-185b-432a-add7-7ed969b6b987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:22.522005 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c7793-185b-432a-add7-7ed969b6b987 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:22.541952 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 296/579] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:22.541952 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c7793-185b-432a-add7-7ed969b6b987 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:22.548196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad49ae-bc26-4479-836d-3b7ee232a620 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:22.608830 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c668377-f5f5-400d-b9a1-87e99020886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:22.609598 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668377-f5f5-400d-b9a1-87e99020886a None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.609885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668377-f5f5-400d-b9a1-87e99020886a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.610113 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668377-f5f5-400d-b9a1-87e99020886a None admin] PATH_INFO: `/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/8fcc9424a8984a3db449c23bb5908eb2/roles/a0c07ffc05d54106b2f356d6f76ae54b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:22.627802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c668377-f5f5-400d-b9a1-87e99020886a None admin] RBAC: Authorizing `identity:create_grant(project_id=715f57a8ea67473baf35f0bc91c0ffdb, user_id=8fcc9424a8984a3db449c23bb5908eb2, role_id=a0c07ffc05d54106b2f356d6f76ae54b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:22.629452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c668377-f5f5-400d-b9a1-87e99020886a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:22.653947 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 284/580] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:39:22 2022] PUT /identity/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/8fcc9424a8984a3db449c23bb5908eb2/roles/a0c07ffc05d54106b2f356d6f76ae54b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:39:22.653947 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c668377-f5f5-400d-b9a1-87e99020886a None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:22.709523 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c7793-185b-432a-add7-7ed969b6b987 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:22.736845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:22.776037 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c99ea-336a-479e-a057-5f7157503ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:22.778365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c99ea-336a-479e-a057-5f7157503ca1 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.778734 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c99ea-336a-479e-a057-5f7157503ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.778915 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c99ea-336a-479e-a057-5f7157503ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:22.779694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c99ea-336a-479e-a057-5f7157503ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:22.780450 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c99ea-336a-479e-a057-5f7157503ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:22.782803 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c99ea-336a-479e-a057-5f7157503ca1 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:22.801992 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 297/581] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:22.802707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794e29-c587-4378-a5f2-3a886da34b3e None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.803082 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794e29-c587-4378-a5f2-3a886da34b3e None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.803349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794e29-c587-4378-a5f2-3a886da34b3e None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:22.805738 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 298/582] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:22.808561 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72794e29-c587-4378-a5f2-3a886da34b3e None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:22.820137 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c668377-f5f5-400d-b9a1-87e99020886a None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:22.842912 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:22.862578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cb263-b6a6-4cf2-8a46-63c3c94d1fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:22.863416 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cb263-b6a6-4cf2-8a46-63c3c94d1fc7 None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.863798 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cb263-b6a6-4cf2-8a46-63c3c94d1fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.864192 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cb263-b6a6-4cf2-8a46-63c3c94d1fc7 None admin] PATH_INFO: `/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/e541d55268064ad986a5d05108120f62/roles/a0c07ffc05d54106b2f356d6f76ae54b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:22.883524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cb263-b6a6-4cf2-8a46-63c3c94d1fc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=715f57a8ea67473baf35f0bc91c0ffdb, user_id=e541d55268064ad986a5d05108120f62, role_id=a0c07ffc05d54106b2f356d6f76ae54b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:22.885087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cb263-b6a6-4cf2-8a46-63c3c94d1fc7 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:22.903093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 285/583] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:39:22 2022] PUT /identity/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/e541d55268064ad986a5d05108120f62/roles/a0c07ffc05d54106b2f356d6f76ae54b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:39:22.904593 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ddf2c-1231-49c2-bc31-aafeb08fd61a None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.904925 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ddf2c-1231-49c2-bc31-aafeb08fd61a None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.905270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ddf2c-1231-49c2-bc31-aafeb08fd61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:22.932204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-489ddf2c-1231-49c2-bc31-aafeb08fd61a None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:22.934035 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-489ddf2c-1231-49c2-bc31-aafeb08fd61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:22.955289 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72794e29-c587-4378-a5f2-3a886da34b3e None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:22.998608 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf2756-456d-4287-84ee-6e3679e5d092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:22.999298 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf2756-456d-4287-84ee-6e3679e5d092 None admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:22.999590 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf2756-456d-4287-84ee-6e3679e5d092 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:22.999844 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf2756-456d-4287-84ee-6e3679e5d092 None admin] PATH_INFO: `/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/ff8273f4715e4f8ca50106a9abf7781b/roles/a0c07ffc05d54106b2f356d6f76ae54b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:23.016949 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf2756-456d-4287-84ee-6e3679e5d092 None admin] RBAC: Authorizing `identity:create_grant(project_id=715f57a8ea67473baf35f0bc91c0ffdb, user_id=ff8273f4715e4f8ca50106a9abf7781b, role_id=a0c07ffc05d54106b2f356d6f76ae54b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:23.018646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf2756-456d-4287-84ee-6e3679e5d092 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:23.025124 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 286/584] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:23.053816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 299/585] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:39:22 2022] PUT /identity/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/ff8273f4715e4f8ca50106a9abf7781b/roles/a0c07ffc05d54106b2f356d6f76ae54b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:39:23.396540 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ddf2c-1231-49c2-bc31-aafeb08fd61a None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:23.429336 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:23.524498 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ddf2c-1231-49c2-bc31-aafeb08fd61a None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:23.568953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8bb0f-8b8d-4b2f-9b7c-0a8c8222bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:23.570547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8bb0f-8b8d-4b2f-9b7c-0a8c8222bdef None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:23.571291 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8bb0f-8b8d-4b2f-9b7c-0a8c8222bdef None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:23.572077 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8bb0f-8b8d-4b2f-9b7c-0a8c8222bdef None admin] PATH_INFO: `/v3/roles/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:23.593358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8bb0f-8b8d-4b2f-9b7c-0a8c8222bdef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-a3b8bb0f-8b8d-4b2f-9b7c-0a8c8222bdef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:23.603597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:23.605286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:23.606862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:23.611553 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 287/586] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:23.623206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf2756-456d-4287-84ee-6e3679e5d092 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:23.740541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:23.781420 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf2756-456d-4287-84ee-6e3679e5d092 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:23.823006 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c323b-ba3e-4c54-8234-4574b9be7d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:23.824040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c323b-ba3e-4c54-8234-4574b9be7d70 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:23.824516 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c323b-ba3e-4c54-8234-4574b9be7d70 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:23.824986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c323b-ba3e-4c54-8234-4574b9be7d70 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:23.826269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c323b-ba3e-4c54-8234-4574b9be7d70 None admin] RBAC: Adding query filter params (name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:23.826752 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c323b-ba3e-4c54-8234-4574b9be7d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:23.829263 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c323b-ba3e-4c54-8234-4574b9be7d70 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:23.848927 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 300/587] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:23.859595 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8bb0f-8b8d-4b2f-9b7c-0a8c8222bdef None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:24.025288 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:24.054484 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8bb0f-8b8d-4b2f-9b7c-0a8c8222bdef None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:24.097073 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c479cd-0ff2-4cb3-8440-bc4f8606ba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:24.097716 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c479cd-0ff2-4cb3-8440-bc4f8606ba74 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:24.098012 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c479cd-0ff2-4cb3-8440-bc4f8606ba74 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:24.098268 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c479cd-0ff2-4cb3-8440-bc4f8606ba74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:24.110687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c479cd-0ff2-4cb3-8440-bc4f8606ba74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:24.112780 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c479cd-0ff2-4cb3-8440-bc4f8606ba74 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-b1c479cd-0ff2-4cb3-8440-bc4f8606ba74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:24.130854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:24.131862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:24.133980 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:24.133980 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:24.133980 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:24.133980 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 288/588] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:24.138289 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c323b-ba3e-4c54-8234-4574b9be7d70 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:24.273772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c323b-ba3e-4c54-8234-4574b9be7d70 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:24.310323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12e971-448e-45e7-9976-a5eb6d10aedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:24.310848 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12e971-448e-45e7-9976-a5eb6d10aedd None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:24.311198 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12e971-448e-45e7-9976-a5eb6d10aedd None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:24.311537 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12e971-448e-45e7-9976-a5eb6d10aedd None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:24.312185 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12e971-448e-45e7-9976-a5eb6d10aedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:24.312534 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12e971-448e-45e7-9976-a5eb6d10aedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:24.314308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12e971-448e-45e7-9976-a5eb6d10aedd None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:24.316115 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:24.335178 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 301/589] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:24.341688 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c479cd-0ff2-4cb3-8440-bc4f8606ba74 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:24.483897 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c479cd-0ff2-4cb3-8440-bc4f8606ba74 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:24.540306 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d7731-3622-46b6-b188-0a411c5747a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:24.541300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7731-3622-46b6-b188-0a411c5747a0 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:24.541736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7731-3622-46b6-b188-0a411c5747a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:24.542103 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7731-3622-46b6-b188-0a411c5747a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:24.551852 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d7731-3622-46b6-b188-0a411c5747a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:24.553462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d7731-3622-46b6-b188-0a411c5747a0 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-fa7d7731-3622-46b6-b188-0a411c5747a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:24.568071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:24.569067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 289/590] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 14:39:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:24.570770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:24.576839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12e971-448e-45e7-9976-a5eb6d10aedd None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:24.718621 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12e971-448e-45e7-9976-a5eb6d10aedd None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:24.765444 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8de41-a45f-4a77-a0fc-b56e9175f457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:24.766090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8de41-a45f-4a77-a0fc-b56e9175f457 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:24.766368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8de41-a45f-4a77-a0fc-b56e9175f457 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:24.766644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8de41-a45f-4a77-a0fc-b56e9175f457 None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:24.767445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8de41-a45f-4a77-a0fc-b56e9175f457 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:24.767751 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8de41-a45f-4a77-a0fc-b56e9175f457 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:24.769323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8de41-a45f-4a77-a0fc-b56e9175f457 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:24.790892 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 302/591] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 14:39:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:24.799503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d7731-3622-46b6-b188-0a411c5747a0 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:24.946076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d7731-3622-46b6-b188-0a411c5747a0 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:24.988376 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287478dc-ce6b-4aeb-8e80-088648015fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:24.988997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287478dc-ce6b-4aeb-8e80-088648015fbf None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:24.989272 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287478dc-ce6b-4aeb-8e80-088648015fbf None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:24.989544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287478dc-ce6b-4aeb-8e80-088648015fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:25.076257 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:25.079493 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287478dc-ce6b-4aeb-8e80-088648015fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:25.082148 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287478dc-ce6b-4aeb-8e80-088648015fbf None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:25.235564 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 290/592] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:25.241169 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8de41-a45f-4a77-a0fc-b56e9175f457 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:25.316332 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:25.398052 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8de41-a45f-4a77-a0fc-b56e9175f457 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:25.423737 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837e2be-e8e1-4dec-8cbe-936c678b5eb5 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:25.424347 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837e2be-e8e1-4dec-8cbe-936c678b5eb5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:25.424805 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837e2be-e8e1-4dec-8cbe-936c678b5eb5 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:25.426919 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 291/593] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:25.434250 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d98e0-847a-4983-b43b-e790020e8c95 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:25.435008 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d98e0-847a-4983-b43b-e790020e8c95 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:25.435472 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d98e0-847a-4983-b43b-e790020e8c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:25.446312 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790750c-8274-4b61-95fb-2dee773edb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:25.447111 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790750c-8274-4b61-95fb-2dee773edb88 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:25.447381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790750c-8274-4b61-95fb-2dee773edb88 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:25.447653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790750c-8274-4b61-95fb-2dee773edb88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:25.458154 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-2a0d98e0-847a-4983-b43b-e790020e8c95 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:25.459011 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-2a0d98e0-847a-4983-b43b-e790020e8c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:25.459182 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790750c-8274-4b61-95fb-2dee773edb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:25.460821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790750c-8274-4b61-95fb-2dee773edb88 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-8790750c-8274-4b61-95fb-2dee773edb88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:25.477853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:25.480044 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:25.481019 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:25.481019 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:25.481019 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:25.481019 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 303/594] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:25.481019 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9480a-aa9a-462d-9b9f-df03192ec36a None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:25.481019 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9480a-aa9a-462d-9b9f-df03192ec36a None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:25.481367 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9480a-aa9a-462d-9b9f-df03192ec36a None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:25.486047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 304/595] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:25.489927 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9480a-aa9a-462d-9b9f-df03192ec36a None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:25.556212 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 292/596] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:25.557402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54dc22-812f-4cc9-bf1f-b27702fe62e2 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:25.557737 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54dc22-812f-4cc9-bf1f-b27702fe62e2 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:25.558045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54dc22-812f-4cc9-bf1f-b27702fe62e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:25.583394 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-aa54dc22-812f-4cc9-bf1f-b27702fe62e2 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:25.585135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-aa54dc22-812f-4cc9-bf1f-b27702fe62e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:25.612930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:25.636355 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9480a-aa9a-462d-9b9f-df03192ec36a None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:25.639308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:25.674498 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 293/597] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:25.681469 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda2a5d-33e6-4499-8c30-b3d397745fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:25.682494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda2a5d-33e6-4499-8c30-b3d397745fa7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:25.682915 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda2a5d-33e6-4499-8c30-b3d397745fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:25.683326 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda2a5d-33e6-4499-8c30-b3d397745fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:25.684197 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda2a5d-33e6-4499-8c30-b3d397745fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:25.684723 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda2a5d-33e6-4499-8c30-b3d397745fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:25.686589 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda2a5d-33e6-4499-8c30-b3d397745fa7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:25.707021 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 305/598] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:25.708790 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54dc22-812f-4cc9-bf1f-b27702fe62e2 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:25.850479 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54dc22-812f-4cc9-bf1f-b27702fe62e2 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:25.887811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55086b5-ea26-4479-9065-1319f647be4f None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:25.888368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55086b5-ea26-4479-9065-1319f647be4f None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:25.888368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55086b5-ea26-4479-9065-1319f647be4f None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:25.894350 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 306/599] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:25.896941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20a2db-a9f7-4373-90c6-8c5db45c063e None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:25.897425 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20a2db-a9f7-4373-90c6-8c5db45c063e None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:25.897890 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20a2db-a9f7-4373-90c6-8c5db45c063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:25.899547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea986b-5278-459f-9e2e-79f6829970f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:25.900924 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea986b-5278-459f-9e2e-79f6829970f8 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:25.901532 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea986b-5278-459f-9e2e-79f6829970f8 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:25.902322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea986b-5278-459f-9e2e-79f6829970f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:25.913284 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea986b-5278-459f-9e2e-79f6829970f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:25.915174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea986b-5278-459f-9e2e-79f6829970f8 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-f1ea986b-5278-459f-9e2e-79f6829970f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:25.928983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:25.930116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:25.931185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:25.931185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:25.931185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:25.931185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:25.931185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:25.931185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:25.931185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:25.931185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:25.937629 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-4d20a2db-a9f7-4373-90c6-8c5db45c063e None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:25.937629 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-4d20a2db-a9f7-4373-90c6-8c5db45c063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:25.937929 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 294/600] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:39:25.940032 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea986b-5278-459f-9e2e-79f6829970f8 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:25.977217 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:26.022114 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 307/601] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:26.023467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20a2db-a9f7-4373-90c6-8c5db45c063e None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:26.102312 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea986b-5278-459f-9e2e-79f6829970f8 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:26.158213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789b11-960c-4f94-81bd-3d6ef8b59af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:26.158847 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789b11-960c-4f94-81bd-3d6ef8b59af6 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:26.159127 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789b11-960c-4f94-81bd-3d6ef8b59af6 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:26.159353 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:26.159461 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789b11-960c-4f94-81bd-3d6ef8b59af6 None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:26.160142 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71789b11-960c-4f94-81bd-3d6ef8b59af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:26.160525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71789b11-960c-4f94-81bd-3d6ef8b59af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:26.162299 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71789b11-960c-4f94-81bd-3d6ef8b59af6 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:26.169881 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20a2db-a9f7-4373-90c6-8c5db45c063e None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:26.185608 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 295/602] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:26.185608 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789b11-960c-4f94-81bd-3d6ef8b59af6 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:26.229661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fe61a-4a78-404c-a18d-71e3ad1dd46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:26.230595 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fe61a-4a78-404c-a18d-71e3ad1dd46d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:26.231016 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fe61a-4a78-404c-a18d-71e3ad1dd46d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:26.231497 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fe61a-4a78-404c-a18d-71e3ad1dd46d None admin] PATH_INFO: `/v3/roles/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:26.252366 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fe61a-4a78-404c-a18d-71e3ad1dd46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-a45fe61a-4a78-404c-a18d-71e3ad1dd46d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:26.258500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:26.260347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 308/603] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:26.263090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fe61a-4a78-404c-a18d-71e3ad1dd46d None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:26.312301 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:26.349927 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789b11-960c-4f94-81bd-3d6ef8b59af6 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:26.395909 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75d95e-444c-46e0-b31e-78a849c35b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:26.395909 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75d95e-444c-46e0-b31e-78a849c35b53 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:26.395909 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75d95e-444c-46e0-b31e-78a849c35b53 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:26.395909 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75d95e-444c-46e0-b31e-78a849c35b53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:26.402454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fe61a-4a78-404c-a18d-71e3ad1dd46d None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:26.408590 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75d95e-444c-46e0-b31e-78a849c35b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-ea75d95e-444c-46e0-b31e-78a849c35b53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:26.414325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:26.417139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 296/604] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:26.418241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75d95e-444c-46e0-b31e-78a849c35b53 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:26.450538 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704db5f2-59d9-4efa-a4df-d9f0c4d86557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:26.451149 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db5f2-59d9-4efa-a4df-d9f0c4d86557 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:26.451423 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db5f2-59d9-4efa-a4df-d9f0c4d86557 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:26.451692 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db5f2-59d9-4efa-a4df-d9f0c4d86557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:26.452423 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704db5f2-59d9-4efa-a4df-d9f0c4d86557 None admin] RBAC: Adding query filter params (role.id=a0c07ffc05d54106b2f356d6f76ae54b, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=c1a9ed9280d249f9a76d037ff8407082) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:26.452725 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704db5f2-59d9-4efa-a4df-d9f0c4d86557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:26.454234 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704db5f2-59d9-4efa-a4df-d9f0c4d86557 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:26.460462 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 309/605] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:39:26 2022] GET /identity/v3/role_assignments?user.id=c1a9ed9280d249f9a76d037ff8407082&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=a0c07ffc05d54106b2f356d6f76ae54b => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:26.461298 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704db5f2-59d9-4efa-a4df-d9f0c4d86557 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:26.483739 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:26.566370 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75d95e-444c-46e0-b31e-78a849c35b53 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:26.619534 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1852f-4bc9-4ff8-bb8c-5a07f4ad3f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:26.620417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1852f-4bc9-4ff8-bb8c-5a07f4ad3f69 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:26.620853 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1852f-4bc9-4ff8-bb8c-5a07f4ad3f69 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:26.621226 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1852f-4bc9-4ff8-bb8c-5a07f4ad3f69 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:26.622404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1852f-4bc9-4ff8-bb8c-5a07f4ad3f69 None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:26.622943 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1852f-4bc9-4ff8-bb8c-5a07f4ad3f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:26.625517 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1852f-4bc9-4ff8-bb8c-5a07f4ad3f69 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:26.649095 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 297/606] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:26.649095 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1852f-4bc9-4ff8-bb8c-5a07f4ad3f69 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:26.649502 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704db5f2-59d9-4efa-a4df-d9f0c4d86557 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:26.655775 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:26.705984 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b906-dae2-48a7-a61c-2748d4374a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:26.706864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b906-dae2-48a7-a61c-2748d4374a9c None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:26.707323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b906-dae2-48a7-a61c-2748d4374a9c None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:26.708392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b906-dae2-48a7-a61c-2748d4374a9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:26.725381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54b906-dae2-48a7-a61c-2748d4374a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-cd54b906-dae2-48a7-a61c-2748d4374a9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:26.732144 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:26.734407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 310/607] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:26.736370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b906-dae2-48a7-a61c-2748d4374a9c None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:26.843606 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1852f-4bc9-4ff8-bb8c-5a07f4ad3f69 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:26.851171 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:26.884677 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b906-dae2-48a7-a61c-2748d4374a9c None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:26.891443 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e27b42-c5e5-4155-a2e5-118704e6f288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:26.892111 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e27b42-c5e5-4155-a2e5-118704e6f288 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:26.892404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e27b42-c5e5-4155-a2e5-118704e6f288 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:26.892790 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e27b42-c5e5-4155-a2e5-118704e6f288 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:26.893547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e27b42-c5e5-4155-a2e5-118704e6f288 None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:26.893893 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e27b42-c5e5-4155-a2e5-118704e6f288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:26.895417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e27b42-c5e5-4155-a2e5-118704e6f288 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:26.912920 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 298/608] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:26.912920 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e27b42-c5e5-4155-a2e5-118704e6f288 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:26.950439 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0da29a-45f0-4f67-bd9f-07bc4eae431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:26.951488 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0da29a-45f0-4f67-bd9f-07bc4eae431d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:26.951944 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0da29a-45f0-4f67-bd9f-07bc4eae431d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:26.952408 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0da29a-45f0-4f67-bd9f-07bc4eae431d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:26.967388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0da29a-45f0-4f67-bd9f-07bc4eae431d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:26.969358 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0da29a-45f0-4f67-bd9f-07bc4eae431d None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-ee0da29a-45f0-4f67-bd9f-07bc4eae431d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:26.985931 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:26.987526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:26.989353 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:26.989353 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:26.989353 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:26.989353 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 311/609] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:26.993792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0da29a-45f0-4f67-bd9f-07bc4eae431d None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:27.019809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:27.072969 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e27b42-c5e5-4155-a2e5-118704e6f288 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:27.121354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703303a2-3d71-434c-b132-9f5e402443b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:27.122139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703303a2-3d71-434c-b132-9f5e402443b1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:27.122806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703303a2-3d71-434c-b132-9f5e402443b1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:27.123079 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703303a2-3d71-434c-b132-9f5e402443b1 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:27.124258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0da29a-45f0-4f67-bd9f-07bc4eae431d None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:27.125039 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703303a2-3d71-434c-b132-9f5e402443b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:27.125344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703303a2-3d71-434c-b132-9f5e402443b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:27.126760 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703303a2-3d71-434c-b132-9f5e402443b1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:27.138391 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 299/610] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:39:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:27.139000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703303a2-3d71-434c-b132-9f5e402443b1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:27.170206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:27.188695 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373c5f9-53f4-4627-928b-b63514c271df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:27.189657 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373c5f9-53f4-4627-928b-b63514c271df None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:27.190068 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373c5f9-53f4-4627-928b-b63514c271df None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:27.190351 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373c5f9-53f4-4627-928b-b63514c271df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:27.205102 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373c5f9-53f4-4627-928b-b63514c271df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:27.207461 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373c5f9-53f4-4627-928b-b63514c271df None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-9373c5f9-53f4-4627-928b-b63514c271df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:27.224899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:27.226549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:27.227809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:27.227809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:27.227809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:27.231527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 312/611] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:27.232505 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373c5f9-53f4-4627-928b-b63514c271df None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:27.280957 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703303a2-3d71-434c-b132-9f5e402443b1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:27.309455 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:27.323352 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d53b4-93de-474e-a26f-3a51ced0bd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:27.324520 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d53b4-93de-474e-a26f-3a51ced0bd01 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:27.324790 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d53b4-93de-474e-a26f-3a51ced0bd01 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:27.325340 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d53b4-93de-474e-a26f-3a51ced0bd01 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:27.326034 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d53b4-93de-474e-a26f-3a51ced0bd01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:27.326338 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d53b4-93de-474e-a26f-3a51ced0bd01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:27.328898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d53b4-93de-474e-a26f-3a51ced0bd01 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:27.346289 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 300/612] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:27.347503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d53b4-93de-474e-a26f-3a51ced0bd01 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:27.375576 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373c5f9-53f4-4627-928b-b63514c271df None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:27.429311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4962b-e1ba-4b8e-b166-a843c1d2835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:27.430458 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4962b-e1ba-4b8e-b166-a843c1d2835e None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:27.431143 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4962b-e1ba-4b8e-b166-a843c1d2835e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:27.432105 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4962b-e1ba-4b8e-b166-a843c1d2835e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:27.446278 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4962b-e1ba-4b8e-b166-a843c1d2835e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:27.450496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4962b-e1ba-4b8e-b166-a843c1d2835e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-23c4962b-e1ba-4b8e-b166-a843c1d2835e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:27.471904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:27.474341 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:27.476258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:27.476258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:27.476258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:27.476258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 313/613] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:27.476258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4962b-e1ba-4b8e-b166-a843c1d2835e None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:27.511135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d53b4-93de-474e-a26f-3a51ced0bd01 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:27.517624 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:27.558363 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83271717-0fcf-4bd0-8e1f-4597495f7bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:27.558825 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83271717-0fcf-4bd0-8e1f-4597495f7bc4 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:27.559025 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83271717-0fcf-4bd0-8e1f-4597495f7bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:27.559288 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83271717-0fcf-4bd0-8e1f-4597495f7bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:27.559934 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83271717-0fcf-4bd0-8e1f-4597495f7bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:27.560599 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83271717-0fcf-4bd0-8e1f-4597495f7bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:27.561582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83271717-0fcf-4bd0-8e1f-4597495f7bc4 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:27.576065 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 301/614] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:27.577059 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83271717-0fcf-4bd0-8e1f-4597495f7bc4 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:27.626354 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4962b-e1ba-4b8e-b166-a843c1d2835e None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:27.644988 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:27.677461 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948ded3-fe86-4ec2-9a9b-cc673875f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:27.678406 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948ded3-fe86-4ec2-9a9b-cc673875f584 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:27.678818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948ded3-fe86-4ec2-9a9b-cc673875f584 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:27.679212 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948ded3-fe86-4ec2-9a9b-cc673875f584 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:27.691463 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948ded3-fe86-4ec2-9a9b-cc673875f584 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:27.693653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948ded3-fe86-4ec2-9a9b-cc673875f584 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-c948ded3-fe86-4ec2-9a9b-cc673875f584 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:27.711136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:27.712211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 314/615] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:27.713540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948ded3-fe86-4ec2-9a9b-cc673875f584 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:27.715042 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83271717-0fcf-4bd0-8e1f-4597495f7bc4 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:27.777478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f695db2-fe7a-401e-b30a-5f2530b4e02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:27.778907 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f695db2-fe7a-401e-b30a-5f2530b4e02f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:27.779573 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f695db2-fe7a-401e-b30a-5f2530b4e02f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:27.780231 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f695db2-fe7a-401e-b30a-5f2530b4e02f None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:27.781537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f695db2-fe7a-401e-b30a-5f2530b4e02f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:27.782287 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f695db2-fe7a-401e-b30a-5f2530b4e02f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:27.785608 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f695db2-fe7a-401e-b30a-5f2530b4e02f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:27.816351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 302/616] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:27.817979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f695db2-fe7a-401e-b30a-5f2530b4e02f None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:27.865948 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:27.876460 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948ded3-fe86-4ec2-9a9b-cc673875f584 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:27.947467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a94a4-8c55-4122-ac9f-23147bf05716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:27.948392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a94a4-8c55-4122-ac9f-23147bf05716 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:27.948934 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a94a4-8c55-4122-ac9f-23147bf05716 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:27.949433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a94a4-8c55-4122-ac9f-23147bf05716 None admin] PATH_INFO: `/v3/users/glance` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:27.962258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a94a4-8c55-4122-ac9f-23147bf05716 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:27.964085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a94a4-8c55-4122-ac9f-23147bf05716 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-4d7a94a4-8c55-4122-ac9f-23147bf05716 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:27.985053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:27.986369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:27.987605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:27.987605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:27.987605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:27.987605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:27.987605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:27.987605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:27.987605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:27.987605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:27.987605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 14:39:27.987605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:27.994964 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 315/617] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:27.994964 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a94a4-8c55-4122-ac9f-23147bf05716 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:28.021542 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f695db2-fe7a-401e-b30a-5f2530b4e02f None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:28.030829 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:28.064843 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225f7c8-6136-4e48-98c8-b111938bef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:28.065618 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225f7c8-6136-4e48-98c8-b111938bef55 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:28.065975 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225f7c8-6136-4e48-98c8-b111938bef55 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:28.066316 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225f7c8-6136-4e48-98c8-b111938bef55 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:28.067124 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225f7c8-6136-4e48-98c8-b111938bef55 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:28.067490 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225f7c8-6136-4e48-98c8-b111938bef55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:28.068993 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225f7c8-6136-4e48-98c8-b111938bef55 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:28.090160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 303/618] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 14:39:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:28.091073 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225f7c8-6136-4e48-98c8-b111938bef55 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:28.161277 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a94a4-8c55-4122-ac9f-23147bf05716 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:28.197649 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1f48b-8c3c-4650-b262-7847c66130ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:28.198234 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1f48b-8c3c-4650-b262-7847c66130ab None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:28.198501 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1f48b-8c3c-4650-b262-7847c66130ab None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:28.198764 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1f48b-8c3c-4650-b262-7847c66130ab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:28.208351 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1f48b-8c3c-4650-b262-7847c66130ab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:28.209792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1f48b-8c3c-4650-b262-7847c66130ab None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:28.222121 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225f7c8-6136-4e48-98c8-b111938bef55 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-90f1f48b-8c3c-4650-b262-7847c66130ab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:28.231956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:28.233829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:28.235689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 316/619] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:39:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:28.238731 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1f48b-8c3c-4650-b262-7847c66130ab None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:28.258496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:28.278256 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caa958-c128-4c56-9616-6674ab3b7229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:28.279575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caa958-c128-4c56-9616-6674ab3b7229 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:28.280200 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caa958-c128-4c56-9616-6674ab3b7229 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:28.280840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caa958-c128-4c56-9616-6674ab3b7229 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:28.282193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caa958-c128-4c56-9616-6674ab3b7229 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:28.282881 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caa958-c128-4c56-9616-6674ab3b7229 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:28.285532 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caa958-c128-4c56-9616-6674ab3b7229 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:28.316500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 304/620] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Aug 19 14:39:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:28.317888 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caa958-c128-4c56-9616-6674ab3b7229 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:28.348737 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:28.396423 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1f48b-8c3c-4650-b262-7847c66130ab None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:28.456756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa520ae-8973-4012-ab2b-6a387e48bf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:28.457818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa520ae-8973-4012-ab2b-6a387e48bf4a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:28.458168 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa520ae-8973-4012-ab2b-6a387e48bf4a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:28.458412 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa520ae-8973-4012-ab2b-6a387e48bf4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:28.467800 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caa958-c128-4c56-9616-6674ab3b7229 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:28.524344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962902f0-bbee-43e6-85a4-1e3908bfb225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:28.525419 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962902f0-bbee-43e6-85a4-1e3908bfb225 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:28.525863 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962902f0-bbee-43e6-85a4-1e3908bfb225 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:28.526746 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962902f0-bbee-43e6-85a4-1e3908bfb225 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:28.527986 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962902f0-bbee-43e6-85a4-1e3908bfb225 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:28.528828 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962902f0-bbee-43e6-85a4-1e3908bfb225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:28.531404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962902f0-bbee-43e6-85a4-1e3908bfb225 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:28.554640 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 305/621] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Aug 19 14:39:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:28.554640 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962902f0-bbee-43e6-85a4-1e3908bfb225 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:28.574878 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa520ae-8973-4012-ab2b-6a387e48bf4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:28.576455 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa520ae-8973-4012-ab2b-6a387e48bf4a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:28.597488 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:28.665509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:28.693082 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962902f0-bbee-43e6-85a4-1e3908bfb225 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:28.729544 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 317/622] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:28.731378 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa520ae-8973-4012-ab2b-6a387e48bf4a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:28.747902 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d948a6a-ecc7-44c2-b426-ea46a1e15b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:28.748520 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d948a6a-ecc7-44c2-b426-ea46a1e15b97 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:28.748792 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d948a6a-ecc7-44c2-b426-ea46a1e15b97 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:28.749060 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d948a6a-ecc7-44c2-b426-ea46a1e15b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:28.854229 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d948a6a-ecc7-44c2-b426-ea46a1e15b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:28.856318 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d948a6a-ecc7-44c2-b426-ea46a1e15b97 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:28.882293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa520ae-8973-4012-ab2b-6a387e48bf4a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:28.904906 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:28.934183 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f44982-42d2-4e17-8f35-6c0e065d1081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:28.935035 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44982-42d2-4e17-8f35-6c0e065d1081 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:28.935442 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44982-42d2-4e17-8f35-6c0e065d1081 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:28.935792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44982-42d2-4e17-8f35-6c0e065d1081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:28.957536 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:28.981665 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 306/623] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:28.986866 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d948a6a-ecc7-44c2-b426-ea46a1e15b97 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:29.020111 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f44982-42d2-4e17-8f35-6c0e065d1081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:29.021583 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f44982-42d2-4e17-8f35-6c0e065d1081 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:29.104906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d948a6a-ecc7-44c2-b426-ea46a1e15b97 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:29.140969 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 318/624] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:29.143106 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f77d0-759b-449f-8a49-5638ae36bc54 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:29.143561 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f77d0-759b-449f-8a49-5638ae36bc54 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:29.144041 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f77d0-759b-449f-8a49-5638ae36bc54 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:29.146644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 319/625] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:29.148054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f77d0-759b-449f-8a49-5638ae36bc54 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:29.164468 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aef04-b82d-4508-918e-98c87b527ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:29.165118 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aef04-b82d-4508-918e-98c87b527ee7 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:29.165634 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aef04-b82d-4508-918e-98c87b527ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:29.165878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aef04-b82d-4508-918e-98c87b527ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:29.174659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:29.178560 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3aef04-b82d-4508-918e-98c87b527ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:29.180170 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3aef04-b82d-4508-918e-98c87b527ee7 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-9d3aef04-b82d-4508-918e-98c87b527ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:29.197956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:29.199007 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:29.199872 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:29.199872 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:29.199872 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:29.199872 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 307/626] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:29.200119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aef04-b82d-4508-918e-98c87b527ee7 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:29.238707 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:29.291512 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f77d0-759b-449f-8a49-5638ae36bc54 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:29.325364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aef04-b82d-4508-918e-98c87b527ee7 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:29.341397 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8127a3c-55dd-4000-949f-ca8d6b7d9e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:29.342450 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127a3c-55dd-4000-949f-ca8d6b7d9e78 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:29.342887 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127a3c-55dd-4000-949f-ca8d6b7d9e78 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:29.343317 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127a3c-55dd-4000-949f-ca8d6b7d9e78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:29.361158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8127a3c-55dd-4000-949f-ca8d6b7d9e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:29.363676 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8127a3c-55dd-4000-949f-ca8d6b7d9e78 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:29.380426 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf2db-5fce-4ff0-8968-978b0d7fbb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:29.381547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf2db-5fce-4ff0-8968-978b0d7fbb84 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:29.381808 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf2db-5fce-4ff0-8968-978b0d7fbb84 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:29.382276 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf2db-5fce-4ff0-8968-978b0d7fbb84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-e8127a3c-55dd-4000-949f-ca8d6b7d9e78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:29.393959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:29.395627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:29.397207 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:29.397207 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:29.397207 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:29.397207 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 320/627] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:29.398131 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842050ee-3e2d-4b9d-885b-c82dc28e9334 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:29.398131 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842050ee-3e2d-4b9d-885b-c82dc28e9334 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:29.398753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842050ee-3e2d-4b9d-885b-c82dc28e9334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:29.403509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbf2db-5fce-4ff0-8968-978b0d7fbb84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:29.405872 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbf2db-5fce-4ff0-8968-978b0d7fbb84 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:29.428237 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-842050ee-3e2d-4b9d-885b-c82dc28e9334 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-a0dbf2db-5fce-4ff0-8968-978b0d7fbb84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:29.428933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:29.430562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:29.432673 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:29.432673 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:29.432673 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:29.432938 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-842050ee-3e2d-4b9d-885b-c82dc28e9334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:29.433068 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 308/628] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:29.433068 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf2db-5fce-4ff0-8968-978b0d7fbb84 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:29.506445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:29.515742 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 321/629] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:29.516703 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842050ee-3e2d-4b9d-885b-c82dc28e9334 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:29.579506 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:29.608594 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf2db-5fce-4ff0-8968-978b0d7fbb84 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:29.653396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27e4d3-4d6c-4b68-9e77-ae971dc7def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:29.654166 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842050ee-3e2d-4b9d-885b-c82dc28e9334 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:29.654506 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27e4d3-4d6c-4b68-9e77-ae971dc7def7 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:29.655129 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27e4d3-4d6c-4b68-9e77-ae971dc7def7 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:29.655726 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27e4d3-4d6c-4b68-9e77-ae971dc7def7 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:29.656964 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27e4d3-4d6c-4b68-9e77-ae971dc7def7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:29.657401 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27e4d3-4d6c-4b68-9e77-ae971dc7def7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:29.658847 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27e4d3-4d6c-4b68-9e77-ae971dc7def7 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:29.682424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 309/630] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:29.682424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27e4d3-4d6c-4b68-9e77-ae971dc7def7 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:29.709419 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedf048-8fb1-4c57-a3d9-08b0ade05e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:29.710311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedf048-8fb1-4c57-a3d9-08b0ade05e69 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:29.710760 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedf048-8fb1-4c57-a3d9-08b0ade05e69 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:29.711213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedf048-8fb1-4c57-a3d9-08b0ade05e69 None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:29.712056 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedf048-8fb1-4c57-a3d9-08b0ade05e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:29.715348 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedf048-8fb1-4c57-a3d9-08b0ade05e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:29.715348 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedf048-8fb1-4c57-a3d9-08b0ade05e69 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:29.730508 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 322/631] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:29.735199 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedf048-8fb1-4c57-a3d9-08b0ade05e69 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:29.813200 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:29.834217 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27e4d3-4d6c-4b68-9e77-ae971dc7def7 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:29.871286 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedf048-8fb1-4c57-a3d9-08b0ade05e69 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:29.893873 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84895e-c337-4ece-b717-594df190774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:29.894638 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84895e-c337-4ece-b717-594df190774a None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:29.895048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84895e-c337-4ece-b717-594df190774a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:29.895417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84895e-c337-4ece-b717-594df190774a None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:29.896158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84895e-c337-4ece-b717-594df190774a None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:29.896544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84895e-c337-4ece-b717-594df190774a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:29.898196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84895e-c337-4ece-b717-594df190774a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:29.911552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 310/632] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:29.912884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84895e-c337-4ece-b717-594df190774a None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:29.915575 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222b558-8be2-4144-8984-00d85e0a9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:29.916415 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222b558-8be2-4144-8984-00d85e0a9e79 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:29.916689 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222b558-8be2-4144-8984-00d85e0a9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:29.916960 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222b558-8be2-4144-8984-00d85e0a9e79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:29.919346 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:29.925331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222b558-8be2-4144-8984-00d85e0a9e79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:29.926864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222b558-8be2-4144-8984-00d85e0a9e79 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-6222b558-8be2-4144-8984-00d85e0a9e79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:29.943389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:29.944494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:29.945669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:29.945669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:29.945669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:29.945669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:29.945669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:29.945669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:29.945669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:29.945669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:29.945669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 323/633] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:29.945669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222b558-8be2-4144-8984-00d85e0a9e79 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:30.064215 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84895e-c337-4ece-b717-594df190774a None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:30.088549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222b558-8be2-4144-8984-00d85e0a9e79 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:30.103770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90d495-5a12-4cca-9fee-680dcbab5507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:30.104788 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90d495-5a12-4cca-9fee-680dcbab5507 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:30.105192 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90d495-5a12-4cca-9fee-680dcbab5507 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:30.106116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90d495-5a12-4cca-9fee-680dcbab5507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:30.111538 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:30.114727 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90d495-5a12-4cca-9fee-680dcbab5507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:30.116190 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90d495-5a12-4cca-9fee-680dcbab5507 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-4f90d495-5a12-4cca-9fee-680dcbab5507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:30.129158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:30.130421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:30.131417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:30.131417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:30.131417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:30.131417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:30.131417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:30.131417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:30.131417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:30.131417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:30.131417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 311/634] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:30.131898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90d495-5a12-4cca-9fee-680dcbab5507 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:30.138670 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e7629-dced-4205-9e64-ddd4925868cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:30.139570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e7629-dced-4205-9e64-ddd4925868cb None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:30.139962 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e7629-dced-4205-9e64-ddd4925868cb None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:30.140343 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e7629-dced-4205-9e64-ddd4925868cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:30.160217 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e7629-dced-4205-9e64-ddd4925868cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-f83e7629-dced-4205-9e64-ddd4925868cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:30.168266 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:30.169399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 324/635] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:30.171863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e7629-dced-4205-9e64-ddd4925868cb None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:30.221628 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:30.279485 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90d495-5a12-4cca-9fee-680dcbab5507 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:30.317943 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2694f-40eb-4ab8-bfe9-a61b3670f6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:30.318504 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2694f-40eb-4ab8-bfe9-a61b3670f6f7 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:30.318894 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2694f-40eb-4ab8-bfe9-a61b3670f6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:30.319106 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2694f-40eb-4ab8-bfe9-a61b3670f6f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:30.327353 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2694f-40eb-4ab8-bfe9-a61b3670f6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:30.328820 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2694f-40eb-4ab8-bfe9-a61b3670f6f7 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:30.330231 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e7629-dced-4205-9e64-ddd4925868cb None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-c9c2694f-40eb-4ab8-bfe9-a61b3670f6f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:30.342128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:30.343677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:30.345196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:30.345196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:30.345196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:30.345196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:30.345196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:30.345196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:30.345196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:30.345196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:30.348239 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 312/636] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:30.349088 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2694f-40eb-4ab8-bfe9-a61b3670f6f7 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:30.370241 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dd289-88df-40f3-837d-8cb012140186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:30.370881 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd289-88df-40f3-837d-8cb012140186 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:30.371156 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd289-88df-40f3-837d-8cb012140186 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:30.371425 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd289-88df-40f3-837d-8cb012140186 None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:30.372136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dd289-88df-40f3-837d-8cb012140186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:30.372437 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dd289-88df-40f3-837d-8cb012140186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:30.373936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dd289-88df-40f3-837d-8cb012140186 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:30.388489 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 325/637] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:30.389354 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dd289-88df-40f3-837d-8cb012140186 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:30.428517 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:30.495674 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2694f-40eb-4ab8-bfe9-a61b3670f6f7 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:30.520349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dd289-88df-40f3-837d-8cb012140186 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:30.525083 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:30.540808 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278ab18-86ef-41dd-ad43-0d514f0e63a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:30.541640 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ab18-86ef-41dd-ad43-0d514f0e63a0 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:30.542163 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ab18-86ef-41dd-ad43-0d514f0e63a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:30.542624 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ab18-86ef-41dd-ad43-0d514f0e63a0 None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:30.543722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278ab18-86ef-41dd-ad43-0d514f0e63a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:30.544242 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278ab18-86ef-41dd-ad43-0d514f0e63a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:30.545692 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278ab18-86ef-41dd-ad43-0d514f0e63a0 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:30.560231 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 313/638] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:30.560666 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278ab18-86ef-41dd-ad43-0d514f0e63a0 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:30.587104 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc21c7c-9c96-41fd-b41c-c959de7fcbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:30.588017 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc21c7c-9c96-41fd-b41c-c959de7fcbab None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:30.588630 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc21c7c-9c96-41fd-b41c-c959de7fcbab None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:30.589040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc21c7c-9c96-41fd-b41c-c959de7fcbab None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:30.590136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc21c7c-9c96-41fd-b41c-c959de7fcbab None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:30.590574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc21c7c-9c96-41fd-b41c-c959de7fcbab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:30.592718 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc21c7c-9c96-41fd-b41c-c959de7fcbab None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:30.606068 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 326/639] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:30.607119 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc21c7c-9c96-41fd-b41c-c959de7fcbab None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:30.698522 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278ab18-86ef-41dd-ad43-0d514f0e63a0 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:30.725652 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:30.732804 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc21c7c-9c96-41fd-b41c-c959de7fcbab None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:30.745229 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970041d-9405-4dad-a1a2-61be91edf0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:30.745845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970041d-9405-4dad-a1a2-61be91edf0cf None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:30.746155 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970041d-9405-4dad-a1a2-61be91edf0cf None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:30.746426 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970041d-9405-4dad-a1a2-61be91edf0cf None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:30.747129 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970041d-9405-4dad-a1a2-61be91edf0cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:30.747445 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970041d-9405-4dad-a1a2-61be91edf0cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:30.748880 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970041d-9405-4dad-a1a2-61be91edf0cf None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:30.763268 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 314/640] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:30.764198 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970041d-9405-4dad-a1a2-61be91edf0cf None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:30.775771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd4f11-baad-4e59-a3a4-2499b7898c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:30.776796 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd4f11-baad-4e59-a3a4-2499b7898c19 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:30.777322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd4f11-baad-4e59-a3a4-2499b7898c19 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:30.777788 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd4f11-baad-4e59-a3a4-2499b7898c19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:30.779296 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd4f11-baad-4e59-a3a4-2499b7898c19 None admin] RBAC: Adding query filter params (role.id=a0c07ffc05d54106b2f356d6f76ae54b, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=8fcc9424a8984a3db449c23bb5908eb2) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:30.779853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd4f11-baad-4e59-a3a4-2499b7898c19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:30.782998 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd4f11-baad-4e59-a3a4-2499b7898c19 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:30.792271 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 327/641] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:39:30 2022] GET /identity/v3/role_assignments?user.id=8fcc9424a8984a3db449c23bb5908eb2&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=a0c07ffc05d54106b2f356d6f76ae54b => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:30.793386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd4f11-baad-4e59-a3a4-2499b7898c19 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:30.826150 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:30.905475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970041d-9405-4dad-a1a2-61be91edf0cf None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:30.957674 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bbb9b-95e2-4564-a40a-0d13637a08d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:30.958973 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bbb9b-95e2-4564-a40a-0d13637a08d3 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:30.959409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bbb9b-95e2-4564-a40a-0d13637a08d3 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:30.959834 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bbb9b-95e2-4564-a40a-0d13637a08d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:30.961039 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bbb9b-95e2-4564-a40a-0d13637a08d3 None admin] RBAC: Adding query filter params (role.id=a0c07ffc05d54106b2f356d6f76ae54b, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=e541d55268064ad986a5d05108120f62) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:30.961563 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bbb9b-95e2-4564-a40a-0d13637a08d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:30.967549 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bbb9b-95e2-4564-a40a-0d13637a08d3 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:30.985951 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 315/642] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:39:30 2022] GET /identity/v3/role_assignments?user.id=e541d55268064ad986a5d05108120f62&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=a0c07ffc05d54106b2f356d6f76ae54b => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:30.985951 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bbb9b-95e2-4564-a40a-0d13637a08d3 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:30.992200 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd4f11-baad-4e59-a3a4-2499b7898c19 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:31.054784 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2dbb4-608e-4c78-b1f7-1ee8abbc0c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:31.058748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2dbb4-608e-4c78-b1f7-1ee8abbc0c69 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:31.059437 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2dbb4-608e-4c78-b1f7-1ee8abbc0c69 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:31.060063 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2dbb4-608e-4c78-b1f7-1ee8abbc0c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:31.090886 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2dbb4-608e-4c78-b1f7-1ee8abbc0c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:31.091957 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2dbb4-608e-4c78-b1f7-1ee8abbc0c69 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-75b2dbb4-608e-4c78-b1f7-1ee8abbc0c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:31.115219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:31.117101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:31.120069 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:31.120069 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:31.120069 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:31.120069 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 328/643] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:31.134963 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2dbb4-608e-4c78-b1f7-1ee8abbc0c69 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:31.148551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bbb9b-95e2-4564-a40a-0d13637a08d3 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:31.161152 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:31.169653 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:31.216736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801621b-c5db-4b6c-8b94-23de992e0548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:31.219503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801621b-c5db-4b6c-8b94-23de992e0548 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:31.219844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801621b-c5db-4b6c-8b94-23de992e0548 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:31.220094 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801621b-c5db-4b6c-8b94-23de992e0548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:31.221172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801621b-c5db-4b6c-8b94-23de992e0548 None admin] RBAC: Adding query filter params (role.id=a0c07ffc05d54106b2f356d6f76ae54b, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=ff8273f4715e4f8ca50106a9abf7781b) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:31.221172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801621b-c5db-4b6c-8b94-23de992e0548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:31.223464 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801621b-c5db-4b6c-8b94-23de992e0548 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:31.233877 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 316/644] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:39:30 2022] GET /identity/v3/role_assignments?user.id=ff8273f4715e4f8ca50106a9abf7781b&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=a0c07ffc05d54106b2f356d6f76ae54b => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:31.294056 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2dbb4-608e-4c78-b1f7-1ee8abbc0c69 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:31.345679 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643a184-25dc-473f-a6b0-69506ccef8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:31.347023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643a184-25dc-473f-a6b0-69506ccef8cb None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:31.347742 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643a184-25dc-473f-a6b0-69506ccef8cb None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:31.348514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643a184-25dc-473f-a6b0-69506ccef8cb None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:31.349842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643a184-25dc-473f-a6b0-69506ccef8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:31.350623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643a184-25dc-473f-a6b0-69506ccef8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:31.352546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643a184-25dc-473f-a6b0-69506ccef8cb None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:31.376985 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 329/645] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:31.387880 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801621b-c5db-4b6c-8b94-23de992e0548 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:31.518230 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801621b-c5db-4b6c-8b94-23de992e0548 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:31.562583 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97c2f6-5f99-4624-8580-adb77fb9e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:31.563612 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97c2f6-5f99-4624-8580-adb77fb9e6e5 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:31.563883 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97c2f6-5f99-4624-8580-adb77fb9e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:31.564169 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97c2f6-5f99-4624-8580-adb77fb9e6e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:31.579123 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97c2f6-5f99-4624-8580-adb77fb9e6e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:31.581604 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97c2f6-5f99-4624-8580-adb77fb9e6e5 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-3d97c2f6-5f99-4624-8580-adb77fb9e6e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:31.602488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:31.603704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:31.605652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 317/646] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 14:39:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:31.610236 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643a184-25dc-473f-a6b0-69506ccef8cb None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:31.707844 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:31.738049 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643a184-25dc-473f-a6b0-69506ccef8cb None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:31.780095 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9caa3d-bf5c-49fc-95cb-226992a82239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:31.781244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9caa3d-bf5c-49fc-95cb-226992a82239 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:31.781691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9caa3d-bf5c-49fc-95cb-226992a82239 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:31.782108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9caa3d-bf5c-49fc-95cb-226992a82239 None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:31.783289 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9caa3d-bf5c-49fc-95cb-226992a82239 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:31.783937 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9caa3d-bf5c-49fc-95cb-226992a82239 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:31.786584 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9caa3d-bf5c-49fc-95cb-226992a82239 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:31.809049 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 330/647] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 14:39:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:31.814912 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97c2f6-5f99-4624-8580-adb77fb9e6e5 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:31.855899 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:31.939737 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97c2f6-5f99-4624-8580-adb77fb9e6e5 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:31.977750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e905-0167-46c3-986b-1b82ef9536d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:31.978477 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e905-0167-46c3-986b-1b82ef9536d1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:31.978759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e905-0167-46c3-986b-1b82ef9536d1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:31.979031 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e905-0167-46c3-986b-1b82ef9536d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:32.050642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e905-0167-46c3-986b-1b82ef9536d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:32.052093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e905-0167-46c3-986b-1b82ef9536d1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:32.084537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:32.160994 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 318/648] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 14:39:32.169370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9caa3d-bf5c-49fc-95cb-226992a82239 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:32.291668 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9caa3d-bf5c-49fc-95cb-226992a82239 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:32.331994 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:32.340475 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1188cf-3719-42f6-aebe-b7823f1f6163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:32.341128 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1188cf-3719-42f6-aebe-b7823f1f6163 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:32.341458 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1188cf-3719-42f6-aebe-b7823f1f6163 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:32.341730 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1188cf-3719-42f6-aebe-b7823f1f6163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:32.356274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1188cf-3719-42f6-aebe-b7823f1f6163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:32.358412 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1188cf-3719-42f6-aebe-b7823f1f6163 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-ed1188cf-3719-42f6-aebe-b7823f1f6163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:32.380249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:32.381383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:32.382294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:32.382294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:32.382294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:32.382294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 331/649] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:32.395724 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e905-0167-46c3-986b-1b82ef9536d1 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:32.517147 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e905-0167-46c3-986b-1b82ef9536d1 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:32.562355 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:32.567623 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7c757-05df-4a77-8371-ff61cfd099a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:32.568249 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c757-05df-4a77-8371-ff61cfd099a8 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:32.568525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c757-05df-4a77-8371-ff61cfd099a8 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:32.568790 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c757-05df-4a77-8371-ff61cfd099a8 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:32.569441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7c757-05df-4a77-8371-ff61cfd099a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:32.569737 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7c757-05df-4a77-8371-ff61cfd099a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:32.571142 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7c757-05df-4a77-8371-ff61cfd099a8 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:32.585895 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 319/650] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:32.592105 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1188cf-3719-42f6-aebe-b7823f1f6163 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:32.733899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1188cf-3719-42f6-aebe-b7823f1f6163 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:32.778510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb827a-e52d-4cc1-9379-f601a2111648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:32.779691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb827a-e52d-4cc1-9379-f601a2111648 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:32.779973 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb827a-e52d-4cc1-9379-f601a2111648 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:32.780243 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb827a-e52d-4cc1-9379-f601a2111648 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:32.787961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb827a-e52d-4cc1-9379-f601a2111648 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:32.789577 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb827a-e52d-4cc1-9379-f601a2111648 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-7ecb827a-e52d-4cc1-9379-f601a2111648 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:32.802631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:32.803574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:32.804467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:32.804467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:32.804467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:32.804467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:32.804467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:32.804467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:32.804467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:32.804467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:32.804467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 332/651] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:32.811804 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7c757-05df-4a77-8371-ff61cfd099a8 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:32.946453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7c757-05df-4a77-8371-ff61cfd099a8 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:32.986934 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc3e60-d4bc-4f39-8681-4b1aeb1964df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:32.987550 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3e60-d4bc-4f39-8681-4b1aeb1964df None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:32.987986 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3e60-d4bc-4f39-8681-4b1aeb1964df None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:32.988264 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3e60-d4bc-4f39-8681-4b1aeb1964df None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:32.989295 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc3e60-d4bc-4f39-8681-4b1aeb1964df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:32.989646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc3e60-d4bc-4f39-8681-4b1aeb1964df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:32.991290 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc3e60-d4bc-4f39-8681-4b1aeb1964df None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:33.010096 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 320/652] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:33.016147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb827a-e52d-4cc1-9379-f601a2111648 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:33.077051 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:33.149465 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb827a-e52d-4cc1-9379-f601a2111648 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:33.212499 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1be88-2649-4f1f-a005-048a34e7c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:33.214984 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1be88-2649-4f1f-a005-048a34e7c393 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:33.216096 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1be88-2649-4f1f-a005-048a34e7c393 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:33.217761 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1be88-2649-4f1f-a005-048a34e7c393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:33.219529 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1be88-2649-4f1f-a005-048a34e7c393 None admin] RBAC: Adding query filter params (role.id=d444334199c640a7af820f46e283d49d, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=c1a9ed9280d249f9a76d037ff8407082) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:33.219841 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1be88-2649-4f1f-a005-048a34e7c393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:33.221336 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1be88-2649-4f1f-a005-048a34e7c393 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:33.229224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 333/653] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:39:33 2022] GET /identity/v3/role_assignments?user.id=c1a9ed9280d249f9a76d037ff8407082&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=d444334199c640a7af820f46e283d49d => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:33.489879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f511f-ee64-4472-9518-a5327bba4b33 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:33.490428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f511f-ee64-4472-9518-a5327bba4b33 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:33.490636 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f511f-ee64-4472-9518-a5327bba4b33 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:33.492435 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 321/654] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:33.498649 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e8599-86ee-4c67-94f7-251dfe14fd25 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:33.498965 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e8599-86ee-4c67-94f7-251dfe14fd25 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:33.499237 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e8599-86ee-4c67-94f7-251dfe14fd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:33.518739 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-469e8599-86ee-4c67-94f7-251dfe14fd25 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:33.519988 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-469e8599-86ee-4c67-94f7-251dfe14fd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:33.606064 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 334/655] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:33.747426 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48a340-0741-4ece-a214-9df22c5b6ec3 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:33.747800 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48a340-0741-4ece-a214-9df22c5b6ec3 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:33.747981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48a340-0741-4ece-a214-9df22c5b6ec3 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:33.749553 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 322/656] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:33.755129 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cd2e6-c1f5-4fd2-9201-357ae867db21 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:33.755468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cd2e6-c1f5-4fd2-9201-357ae867db21 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:33.755771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cd2e6-c1f5-4fd2-9201-357ae867db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:33.776414 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-252cd2e6-c1f5-4fd2-9201-357ae867db21 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:33.777965 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-252cd2e6-c1f5-4fd2-9201-357ae867db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:33.810905 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:33.834592 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb8f2d-14f1-444f-9c53-370a4f7fb4da None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:33.834909 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb8f2d-14f1-444f-9c53-370a4f7fb4da None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:33.835136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb8f2d-14f1-444f-9c53-370a4f7fb4da None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:33.836743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 323/657] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:33.842110 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d42ad-0f8d-4de7-a886-6310553e1cd3 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:33.842393 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d42ad-0f8d-4de7-a886-6310553e1cd3 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:33.842665 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d42ad-0f8d-4de7-a886-6310553e1cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:33.853419 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 335/658] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:33.874732 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-436d42ad-0f8d-4de7-a886-6310553e1cd3 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:33.876135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-436d42ad-0f8d-4de7-a886-6310553e1cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:33.932768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:33.956514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 324/659] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:33.959534 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cd2e6-c1f5-4fd2-9201-357ae867db21 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:34.072622 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cd2e6-c1f5-4fd2-9201-357ae867db21 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:34.109342 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfb80d-3ac2-4802-b992-99fcfe2dc952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:34.110022 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfb80d-3ac2-4802-b992-99fcfe2dc952 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:34.110330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfb80d-3ac2-4802-b992-99fcfe2dc952 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:34.110688 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfb80d-3ac2-4802-b992-99fcfe2dc952 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:34.111281 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfb80d-3ac2-4802-b992-99fcfe2dc952 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:34.112740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfb80d-3ac2-4802-b992-99fcfe2dc952 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-75cfb80d-3ac2-4802-b992-99fcfe2dc952 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:34.124432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:34.125591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 14:39:34.126476 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:34.130089 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 336/660] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Aug 19 14:39:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:34.133093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d42ad-0f8d-4de7-a886-6310553e1cd3 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:34.233158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfb80d-3ac2-4802-b992-99fcfe2dc952 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:34.255417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d42ad-0f8d-4de7-a886-6310553e1cd3 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:34.271939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:34.303250 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31f00b-81fb-4c14-ad6b-d98d69b00a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:34.303882 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31f00b-81fb-4c14-ad6b-d98d69b00a1e None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:34.304162 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31f00b-81fb-4c14-ad6b-d98d69b00a1e None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:34.304436 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31f00b-81fb-4c14-ad6b-d98d69b00a1e None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:34.305359 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31f00b-81fb-4c14-ad6b-d98d69b00a1e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:34.305664 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31f00b-81fb-4c14-ad6b-d98d69b00a1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:34.308217 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31f00b-81fb-4c14-ad6b-d98d69b00a1e None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:34.320428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 325/661] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 14:39:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:34.323201 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31f00b-81fb-4c14-ad6b-d98d69b00a1e None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:34.382596 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:34.392313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfb80d-3ac2-4802-b992-99fcfe2dc952 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:34.451580 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a075d6-d037-4a5a-9238-a5909b37fe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:34.452375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a075d6-d037-4a5a-9238-a5909b37fe79 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:34.452748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a075d6-d037-4a5a-9238-a5909b37fe79 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:34.453084 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a075d6-d037-4a5a-9238-a5909b37fe79 None admin] PATH_INFO: `/v3/services/image` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:34.453669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a075d6-d037-4a5a-9238-a5909b37fe79 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:34.455113 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a075d6-d037-4a5a-9238-a5909b37fe79 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:34.462322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31f00b-81fb-4c14-ad6b-d98d69b00a1e None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-88a075d6-d037-4a5a-9238-a5909b37fe79 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:34.467297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:34.468438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:34.471536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 337/662] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Aug 19 14:39:34 2022] GET /identity/v3/services/image => generated 86 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:34.473051 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a075d6-d037-4a5a-9238-a5909b37fe79 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:34.523569 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f524b-eaab-499b-b7b4-a4aa3d3518cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:34.524418 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f524b-eaab-499b-b7b4-a4aa3d3518cc None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:34.524715 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f524b-eaab-499b-b7b4-a4aa3d3518cc None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:34.525227 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f524b-eaab-499b-b7b4-a4aa3d3518cc None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:34.526009 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f524b-eaab-499b-b7b4-a4aa3d3518cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:34.526479 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f524b-eaab-499b-b7b4-a4aa3d3518cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:34.528787 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f524b-eaab-499b-b7b4-a4aa3d3518cc None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:34.535698 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 326/663] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 14:39:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:34.536388 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f524b-eaab-499b-b7b4-a4aa3d3518cc None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:34.628776 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:34.635851 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a075d6-d037-4a5a-9238-a5909b37fe79 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:34.676062 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5b590-5cfc-422e-aa6b-f46ba37bc70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:34.676709 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5b590-5cfc-422e-aa6b-f46ba37bc70a None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:34.676991 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5b590-5cfc-422e-aa6b-f46ba37bc70a None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:34.677243 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5b590-5cfc-422e-aa6b-f46ba37bc70a None admin] PATH_INFO: `/v3/services/network` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:34.677835 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5b590-5cfc-422e-aa6b-f46ba37bc70a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:34.679290 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5b590-5cfc-422e-aa6b-f46ba37bc70a None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:34.686884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f524b-eaab-499b-b7b4-a4aa3d3518cc None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-6df5b590-5cfc-422e-aa6b-f46ba37bc70a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:34.690053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:34.691147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 14:39:34.691999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:34.696708 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 338/664] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:34 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:34.697711 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5b590-5cfc-422e-aa6b-f46ba37bc70a None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:34.706103 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:34.744354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4eebd-f4cb-49d3-9f82-e3d8d345f053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:34.745357 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4eebd-f4cb-49d3-9f82-e3d8d345f053 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:34.745854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4eebd-f4cb-49d3-9f82-e3d8d345f053 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:34.746368 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4eebd-f4cb-49d3-9f82-e3d8d345f053 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:34.747221 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4eebd-f4cb-49d3-9f82-e3d8d345f053 None admin] RBAC: Adding query filter params (name=image) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:34.747738 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4eebd-f4cb-49d3-9f82-e3d8d345f053 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:34.749364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4eebd-f4cb-49d3-9f82-e3d8d345f053 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:34.754661 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 327/665] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:34.762332 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4eebd-f4cb-49d3-9f82-e3d8d345f053 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:34.838509 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5b590-5cfc-422e-aa6b-f46ba37bc70a None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:34.891961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93a098-9f3b-455c-adbf-71dc610a9012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:34.892503 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93a098-9f3b-455c-adbf-71dc610a9012 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:34.892970 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93a098-9f3b-455c-adbf-71dc610a9012 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:34.893077 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93a098-9f3b-455c-adbf-71dc610a9012 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:34.893748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93a098-9f3b-455c-adbf-71dc610a9012 None admin] RBAC: Adding query filter params (name=network) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:34.894074 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93a098-9f3b-455c-adbf-71dc610a9012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:34.895822 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93a098-9f3b-455c-adbf-71dc610a9012 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:34.901951 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4eebd-f4cb-49d3-9f82-e3d8d345f053 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:34.902145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 339/666] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:39:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:34.908528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93a098-9f3b-455c-adbf-71dc610a9012 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:34.948739 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac93232-9c67-4850-b569-3cdb9a9b2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:34.949464 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac93232-9c67-4850-b569-3cdb9a9b2188 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:34.949704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac93232-9c67-4850-b569-3cdb9a9b2188 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:34.949966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac93232-9c67-4850-b569-3cdb9a9b2188 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:34.950604 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac93232-9c67-4850-b569-3cdb9a9b2188 None admin] RBAC: Adding query filter params (type=image) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:34.950907 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac93232-9c67-4850-b569-3cdb9a9b2188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:34.952675 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac93232-9c67-4850-b569-3cdb9a9b2188 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:34.954281 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:34.966190 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 328/667] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:35.069191 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93a098-9f3b-455c-adbf-71dc610a9012 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:35.113267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391bdbd-b1bb-44d8-b714-a9e955e5779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:35.114811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391bdbd-b1bb-44d8-b714-a9e955e5779f None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:35.115337 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391bdbd-b1bb-44d8-b714-a9e955e5779f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:35.115810 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391bdbd-b1bb-44d8-b714-a9e955e5779f None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:35.116715 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391bdbd-b1bb-44d8-b714-a9e955e5779f None admin] RBAC: Adding query filter params (type=network) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:35.117268 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391bdbd-b1bb-44d8-b714-a9e955e5779f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:35.119524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391bdbd-b1bb-44d8-b714-a9e955e5779f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:35.127162 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 340/668] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:39:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:35.667732 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3eaea-a54b-4390-9331-a53739e5ebf4 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:35.669335 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3eaea-a54b-4390-9331-a53739e5ebf4 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:35.670160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3eaea-a54b-4390-9331-a53739e5ebf4 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:35.672905 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 329/669] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:35.681327 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443c66e-eac8-44a5-8bc7-ea90265d7345 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:35.682696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443c66e-eac8-44a5-8bc7-ea90265d7345 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:35.683292 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443c66e-eac8-44a5-8bc7-ea90265d7345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:35.703999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-b443c66e-eac8-44a5-8bc7-ea90265d7345 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:35.705865 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-b443c66e-eac8-44a5-8bc7-ea90265d7345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:35.791751 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 341/670] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:36.176687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3eaea-a54b-4390-9331-a53739e5ebf4 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:36.226488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:36.302267 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3eaea-a54b-4390-9331-a53739e5ebf4 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:36.346999 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c275a6-204f-4243-a028-8e04d64b23f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:36.348207 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c275a6-204f-4243-a028-8e04d64b23f0 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:36.348879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c275a6-204f-4243-a028-8e04d64b23f0 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:36.349407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c275a6-204f-4243-a028-8e04d64b23f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:36.366411 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c275a6-204f-4243-a028-8e04d64b23f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-71c275a6-204f-4243-a028-8e04d64b23f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:36.372751 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:36.373878 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:39:36.374752 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:36.377746 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 330/671] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:36.384467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443c66e-eac8-44a5-8bc7-ea90265d7345 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:36.405739 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:36.503317 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443c66e-eac8-44a5-8bc7-ea90265d7345 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:36.542083 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76d308-6141-4288-902a-8e7c7b4ea81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:36.542938 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d308-6141-4288-902a-8e7c7b4ea81c None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:36.543225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d308-6141-4288-902a-8e7c7b4ea81c None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:36.544830 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d308-6141-4288-902a-8e7c7b4ea81c None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:36.545774 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76d308-6141-4288-902a-8e7c7b4ea81c None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:36.546230 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76d308-6141-4288-902a-8e7c7b4ea81c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:36.550002 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76d308-6141-4288-902a-8e7c7b4ea81c None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:36.561660 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 342/672] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:36.567726 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c275a6-204f-4243-a028-8e04d64b23f0 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:36.692806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:36.697540 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c275a6-204f-4243-a028-8e04d64b23f0 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:36.744212 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acb86d-049e-40f8-a9a7-a8068a2bdfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:36.744733 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acb86d-049e-40f8-a9a7-a8068a2bdfa9 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:36.745015 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acb86d-049e-40f8-a9a7-a8068a2bdfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:36.745310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acb86d-049e-40f8-a9a7-a8068a2bdfa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:36.758603 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acb86d-049e-40f8-a9a7-a8068a2bdfa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:36.760192 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acb86d-049e-40f8-a9a7-a8068a2bdfa9 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-b1acb86d-049e-40f8-a9a7-a8068a2bdfa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:36.777246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:36.778300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:36.780331 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:36.780331 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:36.780331 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:36.780331 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 331/673] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:36.784947 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76d308-6141-4288-902a-8e7c7b4ea81c None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:36.874935 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8188d2-f7a4-4a7a-9536-9b06b98e0a1d None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:36.875293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8188d2-f7a4-4a7a-9536-9b06b98e0a1d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:36.875487 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8188d2-f7a4-4a7a-9536-9b06b98e0a1d None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:36.877110 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 332/674] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:36.882901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23222967-cf8b-45d8-af16-3e9697d61e88 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:36.883241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23222967-cf8b-45d8-af16-3e9697d61e88 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:36.883506 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23222967-cf8b-45d8-af16-3e9697d61e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:36.894258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:36.905654 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-23222967-cf8b-45d8-af16-3e9697d61e88 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:36.907266 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-23222967-cf8b-45d8-af16-3e9697d61e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:36.931308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76d308-6141-4288-902a-8e7c7b4ea81c None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:36.997875 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2b363-3570-4358-9980-960429e9db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:36.998576 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b363-3570-4358-9980-960429e9db46 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:36.998856 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b363-3570-4358-9980-960429e9db46 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:36.999140 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b363-3570-4358-9980-960429e9db46 None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:36.999822 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2b363-3570-4358-9980-960429e9db46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:37.000156 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2b363-3570-4358-9980-960429e9db46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:37.001813 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2b363-3570-4358-9980-960429e9db46 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:37.010536 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 333/675] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:37.016780 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 343/676] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:37.022912 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23222967-cf8b-45d8-af16-3e9697d61e88 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:37.130302 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:37.152591 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23222967-cf8b-45d8-af16-3e9697d61e88 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:37.192592 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa7e74-ee07-4b6b-857a-3724ca4bbc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:37.193401 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa7e74-ee07-4b6b-857a-3724ca4bbc2f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:37.193706 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa7e74-ee07-4b6b-857a-3724ca4bbc2f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:37.194057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa7e74-ee07-4b6b-857a-3724ca4bbc2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:37.203810 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa7e74-ee07-4b6b-857a-3724ca4bbc2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:37.205073 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa7e74-ee07-4b6b-857a-3724ca4bbc2f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-d6aa7e74-ee07-4b6b-857a-3724ca4bbc2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:37.219432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:37.220537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:37.221476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 334/677] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 14:39:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:37.227498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2b363-3570-4358-9980-960429e9db46 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:37.358148 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa7e74-ee07-4b6b-857a-3724ca4bbc2f None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:37.363413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2b363-3570-4358-9980-960429e9db46 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:37.412555 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534294c-a656-48c3-8d88-43d3952901df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:37.413220 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534294c-a656-48c3-8d88-43d3952901df None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:37.413500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534294c-a656-48c3-8d88-43d3952901df None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:37.413773 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534294c-a656-48c3-8d88-43d3952901df None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:37.414722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534294c-a656-48c3-8d88-43d3952901df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:37.415035 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534294c-a656-48c3-8d88-43d3952901df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:37.416800 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534294c-a656-48c3-8d88-43d3952901df None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:37.431143 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:37.446025 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 344/678] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 14:39:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:37.451170 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534294c-a656-48c3-8d88-43d3952901df None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:37.500407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa7e74-ee07-4b6b-857a-3724ca4bbc2f None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:37.546186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb1185-2a43-4ffb-826e-65dde062e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:37.547566 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb1185-2a43-4ffb-826e-65dde062e85c None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:37.548243 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb1185-2a43-4ffb-826e-65dde062e85c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:37.548738 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb1185-2a43-4ffb-826e-65dde062e85c None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:37.549953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb1185-2a43-4ffb-826e-65dde062e85c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:37.551934 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb1185-2a43-4ffb-826e-65dde062e85c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:37.571494 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:37.588644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 335/679] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 14:39:37 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 14:39:37.590175 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacca4b-297a-4feb-bad8-0c5a72176eb5 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:37.590464 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacca4b-297a-4feb-bad8-0c5a72176eb5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:37.590741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacca4b-297a-4feb-bad8-0c5a72176eb5 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:37.592364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 336/680] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:37.600540 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194081cf-e0a8-4181-89cd-351cabbec995 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:37.601509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194081cf-e0a8-4181-89cd-351cabbec995 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:37.602297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194081cf-e0a8-4181-89cd-351cabbec995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:37.619447 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534294c-a656-48c3-8d88-43d3952901df None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:37.634173 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-194081cf-e0a8-4181-89cd-351cabbec995 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:37.636329 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-194081cf-e0a8-4181-89cd-351cabbec995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:37.693763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4fee6-ad19-4d6a-90b4-13d4883a42d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:37.694838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4fee6-ad19-4d6a-90b4-13d4883a42d3 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:37.695294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4fee6-ad19-4d6a-90b4-13d4883a42d3 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:37.695757 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4fee6-ad19-4d6a-90b4-13d4883a42d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:37.716101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4fee6-ad19-4d6a-90b4-13d4883a42d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:37.718696 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4fee6-ad19-4d6a-90b4-13d4883a42d3 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-97a4fee6-ad19-4d6a-90b4-13d4883a42d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:37.746673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:37.747769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:37.748834 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:37.748834 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:37.748834 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:37.748834 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 345/681] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:37.750943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1ff6b-1077-4aa1-a7ce-6c92db7ce7ed None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:37.751336 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1ff6b-1077-4aa1-a7ce-6c92db7ce7ed None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:37.751803 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1ff6b-1077-4aa1-a7ce-6c92db7ce7ed None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:37.756868 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 346/682] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:37.757109 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1ff6b-1077-4aa1-a7ce-6c92db7ce7ed None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:37.783135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 337/683] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 14:39:37.785258 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea812b-e40d-4d2b-beed-8dccc6f0dd04 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:37.785540 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea812b-e40d-4d2b-beed-8dccc6f0dd04 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:37.785811 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea812b-e40d-4d2b-beed-8dccc6f0dd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:37.806486 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-c2ea812b-e40d-4d2b-beed-8dccc6f0dd04 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:37.807761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c2ea812b-e40d-4d2b-beed-8dccc6f0dd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:37.841616 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:37.922630 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 338/684] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 14:39:37.933522 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1ff6b-1077-4aa1-a7ce-6c92db7ce7ed None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:37.976552 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a7765-a00d-4367-aaca-5f3023a0fb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:37.977253 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a7765-a00d-4367-aaca-5f3023a0fb63 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:37.977529 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a7765-a00d-4367-aaca-5f3023a0fb63 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:37.977863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a7765-a00d-4367-aaca-5f3023a0fb63 None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:37.978770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a7765-a00d-4367-aaca-5f3023a0fb63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:37.979080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a7765-a00d-4367-aaca-5f3023a0fb63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:37.980604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a7765-a00d-4367-aaca-5f3023a0fb63 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:38.000980 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 347/685] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:38.011589 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea812b-e40d-4d2b-beed-8dccc6f0dd04 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:38.105070 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:38.155785 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea812b-e40d-4d2b-beed-8dccc6f0dd04 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:38.168669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a7765-a00d-4367-aaca-5f3023a0fb63 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:38.195986 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7b090-2f06-40a3-8b09-cc117bc66e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:38.196602 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7b090-2f06-40a3-8b09-cc117bc66e36 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:38.196904 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7b090-2f06-40a3-8b09-cc117bc66e36 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:38.197178 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7b090-2f06-40a3-8b09-cc117bc66e36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:38.204929 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7b090-2f06-40a3-8b09-cc117bc66e36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:38.206587 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7b090-2f06-40a3-8b09-cc117bc66e36 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-99e7b090-2f06-40a3-8b09-cc117bc66e36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:38.219884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:38.221552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:38.223323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:38.223323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:38.223323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:38.223323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:38.223323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:38.223323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:38.223323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:38.223323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:38.223323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 339/686] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:38.226581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7b090-2f06-40a3-8b09-cc117bc66e36 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:38.337983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a7765-a00d-4367-aaca-5f3023a0fb63 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:38.345957 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:38.358551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7b090-2f06-40a3-8b09-cc117bc66e36 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:38.384263 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a51b0c-f12e-4232-b2b8-fb66b65c0bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:38.384895 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a51b0c-f12e-4232-b2b8-fb66b65c0bfa None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:38.385174 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a51b0c-f12e-4232-b2b8-fb66b65c0bfa None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:38.385486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a51b0c-f12e-4232-b2b8-fb66b65c0bfa None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:38.386147 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a51b0c-f12e-4232-b2b8-fb66b65c0bfa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:38.387558 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a51b0c-f12e-4232-b2b8-fb66b65c0bfa None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:38.399940 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:38.411670 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 348/687] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 14:39:38 2022] POST /identity/v3/services => generated 240 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:39:38.412975 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a51b0c-f12e-4232-b2b8-fb66b65c0bfa None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:38.447415 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434a0c5-b4f1-4345-9fb8-6f0f8063e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:38.448410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434a0c5-b4f1-4345-9fb8-6f0f8063e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:38.448696 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434a0c5-b4f1-4345-9fb8-6f0f8063e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:38.448991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434a0c5-b4f1-4345-9fb8-6f0f8063e3d6 None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:38.450274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434a0c5-b4f1-4345-9fb8-6f0f8063e3d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:38.450741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434a0c5-b4f1-4345-9fb8-6f0f8063e3d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:38.452804 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434a0c5-b4f1-4345-9fb8-6f0f8063e3d6 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:38.474025 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 340/688] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:38.475468 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434a0c5-b4f1-4345-9fb8-6f0f8063e3d6 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:38.585763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a51b0c-f12e-4232-b2b8-fb66b65c0bfa None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:38.633627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fabfad-7e56-4f69-a76a-cbbcd12a999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:38.634554 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434a0c5-b4f1-4345-9fb8-6f0f8063e3d6 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:38.635360 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabfad-7e56-4f69-a76a-cbbcd12a999f None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:38.635817 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabfad-7e56-4f69-a76a-cbbcd12a999f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:38.636257 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabfad-7e56-4f69-a76a-cbbcd12a999f None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:38.638203 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabfad-7e56-4f69-a76a-cbbcd12a999f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:38.639694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabfad-7e56-4f69-a76a-cbbcd12a999f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:38.664835 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 349/689] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 14:39:38 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:39:38.694398 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd3bb7-e11c-42f3-9b4b-66376a4d05cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:38.695117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3bb7-e11c-42f3-9b4b-66376a4d05cc None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:38.695393 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3bb7-e11c-42f3-9b4b-66376a4d05cc None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:38.695662 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3bb7-e11c-42f3-9b4b-66376a4d05cc None admin] PATH_INFO: `/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/c1a9ed9280d249f9a76d037ff8407082/roles/d444334199c640a7af820f46e283d49d` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:38.699194 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd3bb7-e11c-42f3-9b4b-66376a4d05cc None admin] RBAC: Authorizing `identity:create_grant(project_id=715f57a8ea67473baf35f0bc91c0ffdb, user_id=c1a9ed9280d249f9a76d037ff8407082, role_id=d444334199c640a7af820f46e283d49d)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:38.700255 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd3bb7-e11c-42f3-9b4b-66376a4d05cc None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:38.717292 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 341/690] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:39:38 2022] PUT /identity/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/c1a9ed9280d249f9a76d037ff8407082/roles/d444334199c640a7af820f46e283d49d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:39:40.127997 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa48f-a909-4e42-8357-e855068abfa1 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:40.129058 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa48f-a909-4e42-8357-e855068abfa1 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:40.129536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa48f-a909-4e42-8357-e855068abfa1 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:40.131431 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 350/691] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:40.137803 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b00ea-4922-473a-a6ea-da87800a5299 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:40.138710 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b00ea-4922-473a-a6ea-da87800a5299 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:40.139203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b00ea-4922-473a-a6ea-da87800a5299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:40.159113 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-ba5b00ea-4922-473a-a6ea-da87800a5299 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:40.160657 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-ba5b00ea-4922-473a-a6ea-da87800a5299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:40.191870 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:40.239122 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 342/692] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:40 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:39:40.599219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfa48f-a909-4e42-8357-e855068abfa1 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:40.631107 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:40.745162 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfa48f-a909-4e42-8357-e855068abfa1 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:40.796739 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e214bcb-7ba8-4685-b29c-174d42ef9da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:40.797388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e214bcb-7ba8-4685-b29c-174d42ef9da0 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:40.797659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e214bcb-7ba8-4685-b29c-174d42ef9da0 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:40.797944 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e214bcb-7ba8-4685-b29c-174d42ef9da0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:40.798547 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e214bcb-7ba8-4685-b29c-174d42ef9da0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:40.800026 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e214bcb-7ba8-4685-b29c-174d42ef9da0 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-6e214bcb-7ba8-4685-b29c-174d42ef9da0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:40.810331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:40.812085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:40.813244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 351/693] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Aug 19 14:39:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:40.818072 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b00ea-4922-473a-a6ea-da87800a5299 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:40.966845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b00ea-4922-473a-a6ea-da87800a5299 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:40.989566 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d18f6-522a-4b56-aa79-e23074f0b880 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:40.990525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d18f6-522a-4b56-aa79-e23074f0b880 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:40.992100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d18f6-522a-4b56-aa79-e23074f0b880 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.000779 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 352/694] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:41.003851 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32433b6c-7dc6-447d-9022-b0023ac065bc None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.004223 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32433b6c-7dc6-447d-9022-b0023ac065bc None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.004461 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32433b6c-7dc6-447d-9022-b0023ac065bc None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.006104 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 353/695] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:41.007276 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c166-854a-4b4f-aa6d-88f1c942ad83 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.007550 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c166-854a-4b4f-aa6d-88f1c942ad83 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.007821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c166-854a-4b4f-aa6d-88f1c942ad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.024246 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfd6b6-93b8-4eea-b656-c846c7e71c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:41.025200 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd6b6-93b8-4eea-b656-c846c7e71c0a None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.025629 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd6b6-93b8-4eea-b656-c846c7e71c0a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.025906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd6b6-93b8-4eea-b656-c846c7e71c0a None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.026641 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfd6b6-93b8-4eea-b656-c846c7e71c0a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:41.026946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfd6b6-93b8-4eea-b656-c846c7e71c0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:41.028391 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfd6b6-93b8-4eea-b656-c846c7e71c0a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:41.030979 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-7df9c166-854a-4b4f-aa6d-88f1c942ad83 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:41.032256 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-7df9c166-854a-4b4f-aa6d-88f1c942ad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:41.034168 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 343/696] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 14:39:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:41.038393 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36c96-f120-4bdc-a3fb-0e91f693e04b None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.039239 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36c96-f120-4bdc-a3fb-0e91f693e04b None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.039965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36c96-f120-4bdc-a3fb-0e91f693e04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.071276 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-23b36c96-f120-4bdc-a3fb-0e91f693e04b None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:41.073070 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-23b36c96-f120-4bdc-a3fb-0e91f693e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:41.100204 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:41.123039 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 354/697] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:39:41.129794 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9c166-854a-4b4f-aa6d-88f1c942ad83 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:41.155047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:41.163474 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 344/698] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:39:41.188756 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c4543-2646-43f1-a909-5459c3a549bd None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.189775 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c4543-2646-43f1-a909-5459c3a549bd None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.190093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c4543-2646-43f1-a909-5459c3a549bd None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.191889 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 345/699] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:41.199801 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c80d-bb0a-4a89-9906-65a43bc7f90b None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.200448 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c80d-bb0a-4a89-9906-65a43bc7f90b None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.200867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c80d-bb0a-4a89-9906-65a43bc7f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.228308 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-2ec3c80d-bb0a-4a89-9906-65a43bc7f90b None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:41.230909 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-2ec3c80d-bb0a-4a89-9906-65a43bc7f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:41.268477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9c166-854a-4b4f-aa6d-88f1c942ad83 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:41.309233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e64c4c-4438-4847-88fe-83e67046ec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:41.310166 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e64c4c-4438-4847-88fe-83e67046ec40 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.310509 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e64c4c-4438-4847-88fe-83e67046ec40 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.310844 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e64c4c-4438-4847-88fe-83e67046ec40 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.311569 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e64c4c-4438-4847-88fe-83e67046ec40 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:41.311934 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e64c4c-4438-4847-88fe-83e67046ec40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:41.313394 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e64c4c-4438-4847-88fe-83e67046ec40 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:41.319973 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 355/700] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 14:39:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:41.325847 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e64c4c-4438-4847-88fe-83e67046ec40 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:41.344768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 346/701] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 14:39:41.485479 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:41.506551 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e64c4c-4438-4847-88fe-83e67046ec40 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:41.514342 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c80d-bb0a-4a89-9906-65a43bc7f90b None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:41.556431 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1afaa-1170-4fc4-b9c5-9cee921ee187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:41.557216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1afaa-1170-4fc4-b9c5-9cee921ee187 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.557945 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1afaa-1170-4fc4-b9c5-9cee921ee187 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.558238 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1afaa-1170-4fc4-b9c5-9cee921ee187 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.559237 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1afaa-1170-4fc4-b9c5-9cee921ee187 None admin] RBAC: Adding query filter params (interface=public, service_id=e62928e59b98448091bc620d1427f54c, region_id=RegionOne) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:41.559551 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1afaa-1170-4fc4-b9c5-9cee921ee187 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:41.561672 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1afaa-1170-4fc4-b9c5-9cee921ee187 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:41.571428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 356/702] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 14:39:41 2022] GET /identity/v3/endpoints?service_id=e62928e59b98448091bc620d1427f54c&interface=public®ion_id=RegionOne => generated 194 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:41.572389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1afaa-1170-4fc4-b9c5-9cee921ee187 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:41.635351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:41.655763 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c80d-bb0a-4a89-9906-65a43bc7f90b None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:41.711861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f01e25-6d4b-42dc-922f-536d3b46c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:41.713293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f01e25-6d4b-42dc-922f-536d3b46c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.713572 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f01e25-6d4b-42dc-922f-536d3b46c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.713846 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f01e25-6d4b-42dc-922f-536d3b46c5e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.714607 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f01e25-6d4b-42dc-922f-536d3b46c5e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:41.716097 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f01e25-6d4b-42dc-922f-536d3b46c5e4 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-84f01e25-6d4b-42dc-922f-536d3b46c5e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:41.729143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:41.730348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:41.736528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 347/703] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Aug 19 14:39:41 2022] GET /identity/v3/services/image => generated 86 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:41.737318 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f01e25-6d4b-42dc-922f-536d3b46c5e4 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:41.739802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1afaa-1170-4fc4-b9c5-9cee921ee187 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:41.780167 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7a34c-f784-46e2-9727-80d855e193ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:41.780823 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a34c-f784-46e2-9727-80d855e193ac None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.781100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a34c-f784-46e2-9727-80d855e193ac None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.781385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a34c-f784-46e2-9727-80d855e193ac None admin] PATH_INFO: `/v3/services/network` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.782052 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7a34c-f784-46e2-9727-80d855e193ac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:41.783462 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7a34c-f784-46e2-9727-80d855e193ac None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-ebb7a34c-f784-46e2-9727-80d855e193ac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:41.796054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:41.798186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:41.799839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 357/704] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:41 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:41.801487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7a34c-f784-46e2-9727-80d855e193ac None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:41.819493 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:41.863580 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f01e25-6d4b-42dc-922f-536d3b46c5e4 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:41.905070 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e258d-386a-4e52-a096-453a7ff7e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:41.905696 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e258d-386a-4e52-a096-453a7ff7e060 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:41.906023 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e258d-386a-4e52-a096-453a7ff7e060 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:41.906302 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e258d-386a-4e52-a096-453a7ff7e060 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:41.906925 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e258d-386a-4e52-a096-453a7ff7e060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:41.908308 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e258d-386a-4e52-a096-453a7ff7e060 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:41.919312 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 348/705] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 14:39:41 2022] GET /identity/v3/services => generated 1002 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:39:41.920288 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e258d-386a-4e52-a096-453a7ff7e060 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:41.942769 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:41.943039 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7a34c-f784-46e2-9727-80d855e193ac None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:42.001036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38f25d-dddb-4bea-a173-68ffef240cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:42.001975 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38f25d-dddb-4bea-a173-68ffef240cbb None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:42.002193 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38f25d-dddb-4bea-a173-68ffef240cbb None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:42.002457 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38f25d-dddb-4bea-a173-68ffef240cbb None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:42.003365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38f25d-dddb-4bea-a173-68ffef240cbb None admin] RBAC: Adding query filter params (name=image) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:42.003751 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38f25d-dddb-4bea-a173-68ffef240cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:42.005584 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38f25d-dddb-4bea-a173-68ffef240cbb None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:42.020329 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 358/706] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:42.020329 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38f25d-dddb-4bea-a173-68ffef240cbb None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:42.089256 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e258d-386a-4e52-a096-453a7ff7e060 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:42.129893 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47639c-e189-4589-86f5-dd150dcdefa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:42.130573 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47639c-e189-4589-86f5-dd150dcdefa0 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:42.130850 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47639c-e189-4589-86f5-dd150dcdefa0 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:42.131122 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47639c-e189-4589-86f5-dd150dcdefa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:42.142436 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:42.147065 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47639c-e189-4589-86f5-dd150dcdefa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-8b47639c-e189-4589-86f5-dd150dcdefa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:39:42.153809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:42.155066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 349/707] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:39:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:42.155972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47639c-e189-4589-86f5-dd150dcdefa0 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:42.183381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38f25d-dddb-4bea-a173-68ffef240cbb None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:42.244325 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409fdf-72e5-46fe-bac2-85582c48f948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:42.245701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409fdf-72e5-46fe-bac2-85582c48f948 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:42.246355 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409fdf-72e5-46fe-bac2-85582c48f948 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:42.246635 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409fdf-72e5-46fe-bac2-85582c48f948 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:42.247291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52409fdf-72e5-46fe-bac2-85582c48f948 None admin] RBAC: Adding query filter params (name=network) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:42.247593 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52409fdf-72e5-46fe-bac2-85582c48f948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:42.249014 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52409fdf-72e5-46fe-bac2-85582c48f948 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:42.254615 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 359/708] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:39:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:42.255453 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409fdf-72e5-46fe-bac2-85582c48f948 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:42.301900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:42.344130 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47639c-e189-4589-86f5-dd150dcdefa0 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:42.402501 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103296d9-57fe-4fed-b4e2-b3f779f1de17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:42.403142 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103296d9-57fe-4fed-b4e2-b3f779f1de17 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:42.403418 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103296d9-57fe-4fed-b4e2-b3f779f1de17 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:42.403697 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103296d9-57fe-4fed-b4e2-b3f779f1de17 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:42.404327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103296d9-57fe-4fed-b4e2-b3f779f1de17 None admin] RBAC: Adding query filter params (type=image) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:42.404640 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103296d9-57fe-4fed-b4e2-b3f779f1de17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:42.406176 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103296d9-57fe-4fed-b4e2-b3f779f1de17 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:42.418088 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 350/709] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:42.418966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103296d9-57fe-4fed-b4e2-b3f779f1de17 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:42.532164 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409fdf-72e5-46fe-bac2-85582c48f948 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:42.566030 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103296d9-57fe-4fed-b4e2-b3f779f1de17 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:42.575638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273c821-7e42-47c8-b3d3-32b8ef52c24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:42.576253 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273c821-7e42-47c8-b3d3-32b8ef52c24e None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:42.576535 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273c821-7e42-47c8-b3d3-32b8ef52c24e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:42.576798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273c821-7e42-47c8-b3d3-32b8ef52c24e None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:42.577433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273c821-7e42-47c8-b3d3-32b8ef52c24e None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:42.577729 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273c821-7e42-47c8-b3d3-32b8ef52c24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:42.579656 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273c821-7e42-47c8-b3d3-32b8ef52c24e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:42.598328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 360/710] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:42.599133 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273c821-7e42-47c8-b3d3-32b8ef52c24e None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:42.602442 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:42.612105 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15d976-0854-4fe5-87ed-c13964b01dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:42.612749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15d976-0854-4fe5-87ed-c13964b01dde None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:42.613029 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15d976-0854-4fe5-87ed-c13964b01dde None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:42.613303 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15d976-0854-4fe5-87ed-c13964b01dde None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:42.614308 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15d976-0854-4fe5-87ed-c13964b01dde None admin] RBAC: Adding query filter params (type=network) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:42.614615 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15d976-0854-4fe5-87ed-c13964b01dde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:42.616181 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15d976-0854-4fe5-87ed-c13964b01dde None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:42.622024 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 351/711] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:39:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:42.622890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15d976-0854-4fe5-87ed-c13964b01dde None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:42.630453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:42.737358 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273c821-7e42-47c8-b3d3-32b8ef52c24e None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:42.763384 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15d976-0854-4fe5-87ed-c13964b01dde None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:42.778904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7b10b-0b9c-4304-984c-fb8024572ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:42.779520 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7b10b-0b9c-4304-984c-fb8024572ded None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:42.780274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7b10b-0b9c-4304-984c-fb8024572ded None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:42.780274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7b10b-0b9c-4304-984c-fb8024572ded None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:42.780833 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7b10b-0b9c-4304-984c-fb8024572ded None admin] RBAC: Adding query filter params (interface=public, service_id=5ffd28cb601e42c5a21554bc431c66f3, region_id=RegionOne) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:42.781136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7b10b-0b9c-4304-984c-fb8024572ded None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:42.782560 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7b10b-0b9c-4304-984c-fb8024572ded None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:42.794303 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 361/712] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 14:39:42 2022] GET /identity/v3/endpoints?service_id=5ffd28cb601e42c5a21554bc431c66f3&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:42.794303 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7b10b-0b9c-4304-984c-fb8024572ded None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:42.816093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8ced5-4f05-40a2-8fa4-6dc1288649a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:42.817099 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ced5-4f05-40a2-8fa4-6dc1288649a2 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:42.817508 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ced5-4f05-40a2-8fa4-6dc1288649a2 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:42.817784 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ced5-4f05-40a2-8fa4-6dc1288649a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:42.835084 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8ced5-4f05-40a2-8fa4-6dc1288649a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:42.836926 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8ced5-4f05-40a2-8fa4-6dc1288649a2 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-f5c8ced5-4f05-40a2-8fa4-6dc1288649a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:42.858910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:42.859950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:42.860891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:42.860891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:42.860891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:42.860891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 352/713] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:42.861658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8ced5-4f05-40a2-8fa4-6dc1288649a2 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:42.876352 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:42.924323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7b10b-0b9c-4304-984c-fb8024572ded None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:42.961472 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:42.981091 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c1416-b1fb-4e9e-9b53-fe8e94b1d2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:42.981782 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c1416-b1fb-4e9e-9b53-fe8e94b1d2b8 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:42.982087 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c1416-b1fb-4e9e-9b53-fe8e94b1d2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:42.982343 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c1416-b1fb-4e9e-9b53-fe8e94b1d2b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:42.983056 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c1416-b1fb-4e9e-9b53-fe8e94b1d2b8 None admin] RBAC: Adding query filter params (interface=public, service_id=2548e08f286240e6b7f81b3a73df1dc7, region_id=RegionOne) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:42.983360 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c1416-b1fb-4e9e-9b53-fe8e94b1d2b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:42.984742 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c1416-b1fb-4e9e-9b53-fe8e94b1d2b8 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:42.992174 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 362/714] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 14:39:42 2022] GET /identity/v3/endpoints?service_id=2548e08f286240e6b7f81b3a73df1dc7&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:42.992891 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c1416-b1fb-4e9e-9b53-fe8e94b1d2b8 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:43.028948 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8ced5-4f05-40a2-8fa4-6dc1288649a2 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:43.075252 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffef9a9-cdc9-400d-9955-dd022ff8da73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:43.075964 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffef9a9-cdc9-400d-9955-dd022ff8da73 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:43.076289 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffef9a9-cdc9-400d-9955-dd022ff8da73 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:43.076699 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffef9a9-cdc9-400d-9955-dd022ff8da73 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:43.077087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffef9a9-cdc9-400d-9955-dd022ff8da73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:43.078513 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffef9a9-cdc9-400d-9955-dd022ff8da73 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:43.093948 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 353/715] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 14:39:42 2022] GET /identity/v3/services => generated 1002 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:39:43.093948 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffef9a9-cdc9-400d-9955-dd022ff8da73 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:43.158477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c1416-b1fb-4e9e-9b53-fe8e94b1d2b8 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:43.215492 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:43.227080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad89ac-13e0-4a59-8758-f978df5c1c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:43.227885 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad89ac-13e0-4a59-8758-f978df5c1c2f None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:43.228922 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad89ac-13e0-4a59-8758-f978df5c1c2f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:43.229211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad89ac-13e0-4a59-8758-f978df5c1c2f None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:43.230660 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad89ac-13e0-4a59-8758-f978df5c1c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:43.230983 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad89ac-13e0-4a59-8758-f978df5c1c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:43.232420 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad89ac-13e0-4a59-8758-f978df5c1c2f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:43.237201 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffef9a9-cdc9-400d-9955-dd022ff8da73 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:43.247707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 363/716] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:43.255141 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad89ac-13e0-4a59-8758-f978df5c1c2f None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:43.266586 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:43.291485 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd32ae-5359-4a16-a717-5f63835e63a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:43.292229 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd32ae-5359-4a16-a717-5f63835e63a3 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:43.292583 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd32ae-5359-4a16-a717-5f63835e63a3 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:43.292928 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd32ae-5359-4a16-a717-5f63835e63a3 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:43.293631 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd32ae-5359-4a16-a717-5f63835e63a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:43.295173 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd32ae-5359-4a16-a717-5f63835e63a3 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:43.303808 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 354/717] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 14:39:43 2022] GET /identity/v3/services => generated 1002 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:39:43.419586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad89ac-13e0-4a59-8758-f978df5c1c2f None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:43.460263 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88253c7d-5b6c-424e-85ee-5c666528379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:43.460939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88253c7d-5b6c-424e-85ee-5c666528379d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:43.461216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88253c7d-5b6c-424e-85ee-5c666528379d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:43.461485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88253c7d-5b6c-424e-85ee-5c666528379d None admin] PATH_INFO: `/v3/users/nova` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:43.470643 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88253c7d-5b6c-424e-85ee-5c666528379d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:43.472194 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88253c7d-5b6c-424e-85ee-5c666528379d None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-88253c7d-5b6c-424e-85ee-5c666528379d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:39:43.486802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:43.487850 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:43.488801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 364/718] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Aug 19 14:39:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:43.496530 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd32ae-5359-4a16-a717-5f63835e63a3 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:43.651177 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd32ae-5359-4a16-a717-5f63835e63a3 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:43.712327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ccf4d-9192-4e70-a59c-4ca890e3d92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:43.713217 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ccf4d-9192-4e70-a59c-4ca890e3d92a None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:43.713678 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ccf4d-9192-4e70-a59c-4ca890e3d92a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:43.714252 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ccf4d-9192-4e70-a59c-4ca890e3d92a None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:43.715483 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ccf4d-9192-4e70-a59c-4ca890e3d92a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:43.715988 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ccf4d-9192-4e70-a59c-4ca890e3d92a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:43.718469 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ccf4d-9192-4e70-a59c-4ca890e3d92a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:43.747835 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 355/719] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Aug 19 14:39:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:43.755345 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88253c7d-5b6c-424e-85ee-5c666528379d None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:43.815196 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:43.871214 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88253c7d-5b6c-424e-85ee-5c666528379d None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:43.910216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d661d-4ca6-415b-8e88-6f3a8b6418e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:43.910839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d661d-4ca6-415b-8e88-6f3a8b6418e2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:43.911115 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d661d-4ca6-415b-8e88-6f3a8b6418e2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:43.911382 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d661d-4ca6-415b-8e88-6f3a8b6418e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:44.012453 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d661d-4ca6-415b-8e88-6f3a8b6418e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:44.014040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d661d-4ca6-415b-8e88-6f3a8b6418e2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:44.070289 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:44.122655 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 365/720] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:43 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 14:39:44.128517 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ccf4d-9192-4e70-a59c-4ca890e3d92a None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:44.362153 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:44.438058 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ccf4d-9192-4e70-a59c-4ca890e3d92a None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:44.483425 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910a4c6-bc93-479d-9e95-4131bab88b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:44.484730 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a4c6-bc93-479d-9e95-4131bab88b30 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:44.485393 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a4c6-bc93-479d-9e95-4131bab88b30 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:44.486212 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a4c6-bc93-479d-9e95-4131bab88b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:44.497227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8575d2-db05-442e-91d8-38733a0fcc49 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:44.498175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8575d2-db05-442e-91d8-38733a0fcc49 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:44.498175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8575d2-db05-442e-91d8-38733a0fcc49 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:44.499455 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 366/721] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:44.508092 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910a4c6-bc93-479d-9e95-4131bab88b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:44.508331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b07af-4449-4ce2-a359-f606b70ee683 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:44.508331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b07af-4449-4ce2-a359-f606b70ee683 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:44.508331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b07af-4449-4ce2-a359-f606b70ee683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:44.509088 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910a4c6-bc93-479d-9e95-4131bab88b30 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-3910a4c6-bc93-479d-9e95-4131bab88b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:44.526898 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:44.527939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:44.528921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:44.528921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:44.528921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:44.528921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 356/722] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:44.530671 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-4e8b07af-4449-4ce2-a359-f606b70ee683 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:44.532480 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-4e8b07af-4449-4ce2-a359-f606b70ee683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:44.534088 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910a4c6-bc93-479d-9e95-4131bab88b30 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:44.627884 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 367/723] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:44 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 14:39:44.672500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:44.685152 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910a4c6-bc93-479d-9e95-4131bab88b30 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:44.722265 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c369cb-8155-4780-954a-5d013def1147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:44.723280 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c369cb-8155-4780-954a-5d013def1147 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:44.723762 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c369cb-8155-4780-954a-5d013def1147 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:44.724234 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c369cb-8155-4780-954a-5d013def1147 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:44.725102 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c369cb-8155-4780-954a-5d013def1147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:44.725612 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c369cb-8155-4780-954a-5d013def1147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:44.727237 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c369cb-8155-4780-954a-5d013def1147 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:44.740274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 357/724] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:44.751174 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b07af-4449-4ce2-a359-f606b70ee683 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:44.851968 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:44.888594 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b07af-4449-4ce2-a359-f606b70ee683 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:44.951296 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54727b98-e021-41b1-a7dc-7d83b6305267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:44.952368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727b98-e021-41b1-a7dc-7d83b6305267 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:44.952844 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727b98-e021-41b1-a7dc-7d83b6305267 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:44.953317 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727b98-e021-41b1-a7dc-7d83b6305267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:44.966505 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54727b98-e021-41b1-a7dc-7d83b6305267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:44.969211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54727b98-e021-41b1-a7dc-7d83b6305267 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-54727b98-e021-41b1-a7dc-7d83b6305267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:39:44.991498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:44.992514 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:44.993454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:39:44.993454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:39:44.993454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:39:44.993454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:39:44.993454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:39:44.993454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:39:44.993454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:39:44.993454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:44.993901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 368/725] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:45.002944 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c369cb-8155-4780-954a-5d013def1147 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:45.076427 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54727b98-e021-41b1-a7dc-7d83b6305267 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:45.133646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c369cb-8155-4780-954a-5d013def1147 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:45.173311 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b532e9-49aa-4bcf-963d-8075223cd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:45.174333 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b532e9-49aa-4bcf-963d-8075223cd99c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:45.174833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b532e9-49aa-4bcf-963d-8075223cd99c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:45.175368 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b532e9-49aa-4bcf-963d-8075223cd99c None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:45.176386 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b532e9-49aa-4bcf-963d-8075223cd99c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:45.176972 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b532e9-49aa-4bcf-963d-8075223cd99c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:45.178655 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b532e9-49aa-4bcf-963d-8075223cd99c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:45.193862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 358/726] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:45.204168 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b532e9-49aa-4bcf-963d-8075223cd99c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:45.231796 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:45.248433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54727b98-e021-41b1-a7dc-7d83b6305267 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:45.311148 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b02aef-8b60-4c54-af2e-239714ea36a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:45.312175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b02aef-8b60-4c54-af2e-239714ea36a6 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:45.312658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b02aef-8b60-4c54-af2e-239714ea36a6 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:45.313232 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b02aef-8b60-4c54-af2e-239714ea36a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:45.314433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b02aef-8b60-4c54-af2e-239714ea36a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:45.317685 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b02aef-8b60-4c54-af2e-239714ea36a6 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-c4b02aef-8b60-4c54-af2e-239714ea36a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:45.335218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:45.336340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 14:39:45.337640 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:45.338543 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 369/727] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Aug 19 14:39:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:39:45.347388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b02aef-8b60-4c54-af2e-239714ea36a6 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:45.353799 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:45.399028 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b532e9-49aa-4bcf-963d-8075223cd99c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:45.438741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dd24a-8b02-4507-8144-4ce11e3f7b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:45.440006 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dd24a-8b02-4507-8144-4ce11e3f7b45 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:45.440457 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dd24a-8b02-4507-8144-4ce11e3f7b45 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:45.440870 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dd24a-8b02-4507-8144-4ce11e3f7b45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:45.441854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dd24a-8b02-4507-8144-4ce11e3f7b45 None admin] RBAC: Adding query filter params (role.id=d444334199c640a7af820f46e283d49d, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=c1a9ed9280d249f9a76d037ff8407082) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:45.442438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dd24a-8b02-4507-8144-4ce11e3f7b45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:45.444133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dd24a-8b02-4507-8144-4ce11e3f7b45 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:45.452702 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 359/728] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:39:45 2022] GET /identity/v3/role_assignments?user.id=c1a9ed9280d249f9a76d037ff8407082&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=d444334199c640a7af820f46e283d49d => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:45.473885 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b02aef-8b60-4c54-af2e-239714ea36a6 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:45.514811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18deea-364f-4678-8f41-acd11d6b87f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:45.515498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18deea-364f-4678-8f41-acd11d6b87f1 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:45.515740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18deea-364f-4678-8f41-acd11d6b87f1 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:45.515981 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18deea-364f-4678-8f41-acd11d6b87f1 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:45.516607 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18deea-364f-4678-8f41-acd11d6b87f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:45.516901 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18deea-364f-4678-8f41-acd11d6b87f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:45.518377 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18deea-364f-4678-8f41-acd11d6b87f1 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:45.524249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 370/729] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 14:39:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:45.534079 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dd24a-8b02-4507-8144-4ce11e3f7b45 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:45.671474 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:45.701936 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dd24a-8b02-4507-8144-4ce11e3f7b45 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:45.750001 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa104c9b-41ac-4809-9667-6b7fe748a6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:45.750814 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa104c9b-41ac-4809-9667-6b7fe748a6ef None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:45.751093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa104c9b-41ac-4809-9667-6b7fe748a6ef None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:45.751365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa104c9b-41ac-4809-9667-6b7fe748a6ef None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:45.752024 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa104c9b-41ac-4809-9667-6b7fe748a6ef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:45.752326 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa104c9b-41ac-4809-9667-6b7fe748a6ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:45.753740 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa104c9b-41ac-4809-9667-6b7fe748a6ef None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:45.760502 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 360/730] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Aug 19 14:39:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:45.767305 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18deea-364f-4678-8f41-acd11d6b87f1 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:45.859929 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:45.907978 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18deea-364f-4678-8f41-acd11d6b87f1 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:45.924987 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1bd12-9cb5-4882-b414-cf97e69f591b None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:45.925821 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1bd12-9cb5-4882-b414-cf97e69f591b None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:45.926535 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1bd12-9cb5-4882-b414-cf97e69f591b None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:45.929036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 361/731] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:45.936843 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113124-9471-48b9-afec-06eaae0afb18 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:45.937127 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113124-9471-48b9-afec-06eaae0afb18 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:45.937382 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113124-9471-48b9-afec-06eaae0afb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:45.961642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-35113124-9471-48b9-afec-06eaae0afb18 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:45.963304 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-35113124-9471-48b9-afec-06eaae0afb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:45.980989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ee616-fd29-4770-acd8-208217e2ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:45.982008 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee616-fd29-4770-acd8-208217e2ed59 None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:45.982318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee616-fd29-4770-acd8-208217e2ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:45.982617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee616-fd29-4770-acd8-208217e2ed59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:45.983655 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ee616-fd29-4770-acd8-208217e2ed59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:45.985311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ee616-fd29-4770-acd8-208217e2ed59 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:46.012926 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 371/732] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:39:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:39:46.014040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364a5c2-a66e-4e3d-955d-898bfde1e82d None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:46.014336 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364a5c2-a66e-4e3d-955d-898bfde1e82d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:46.014584 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364a5c2-a66e-4e3d-955d-898bfde1e82d None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:46.017975 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 372/733] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:46.022053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f05dc-4861-4082-a968-1c639b9a37d6 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:46.022365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f05dc-4861-4082-a968-1c639b9a37d6 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:46.022649 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f05dc-4861-4082-a968-1c639b9a37d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:46.045605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-d36f05dc-4861-4082-a968-1c639b9a37d6 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:46.047356 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-d36f05dc-4861-4082-a968-1c639b9a37d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:46.082578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 362/734] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:45 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 14:39:46.142725 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 373/735] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:39:46.426895 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35113124-9471-48b9-afec-06eaae0afb18 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:46.499082 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:46.537663 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35113124-9471-48b9-afec-06eaae0afb18 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:46.568034 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f05dc-4861-4082-a968-1c639b9a37d6 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:46.575951 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1006f-5768-455c-bbaa-a08a212eea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:46.576708 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1006f-5768-455c-bbaa-a08a212eea23 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:46.576984 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1006f-5768-455c-bbaa-a08a212eea23 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:46.577240 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1006f-5768-455c-bbaa-a08a212eea23 None admin] PATH_INFO: `/v3/services/image` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:46.577822 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1006f-5768-455c-bbaa-a08a212eea23 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:46.579493 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1006f-5768-455c-bbaa-a08a212eea23 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-e4a1006f-5768-455c-bbaa-a08a212eea23 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:46.589453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:46.592528 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:46.593475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 363/736] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Aug 19 14:39:46 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:46.596951 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1006f-5768-455c-bbaa-a08a212eea23 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:46.664088 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:46.748783 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f05dc-4861-4082-a968-1c639b9a37d6 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:46.771606 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1006f-5768-455c-bbaa-a08a212eea23 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:46.808520 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12099ce4-f827-4682-97a2-9f7062ed6474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:46.810279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099ce4-f827-4682-97a2-9f7062ed6474 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:46.811186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099ce4-f827-4682-97a2-9f7062ed6474 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:46.812312 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099ce4-f827-4682-97a2-9f7062ed6474 None admin] PATH_INFO: `/v3/services/network` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:46.813711 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12099ce4-f827-4682-97a2-9f7062ed6474 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:46.814276 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:46.818743 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12099ce4-f827-4682-97a2-9f7062ed6474 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:46.824661 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4e436-0a8a-4b52-9521-8eb12252c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:46.825349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4e436-0a8a-4b52-9521-8eb12252c32e None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:46.825799 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4e436-0a8a-4b52-9521-8eb12252c32e None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:46.826165 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4e436-0a8a-4b52-9521-8eb12252c32e None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:46.826885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4e436-0a8a-4b52-9521-8eb12252c32e None admin] RBAC: Adding query filter params (name=image) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:46.827262 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4e436-0a8a-4b52-9521-8eb12252c32e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:46.829127 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4e436-0a8a-4b52-9521-8eb12252c32e None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-12099ce4-f827-4682-97a2-9f7062ed6474 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:46.832291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:46.833564 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 14:39:46.835023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:46.837380 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 374/737] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:39:46 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:46.840872 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 364/738] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:46.844373 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12099ce4-f827-4682-97a2-9f7062ed6474 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:46.845774 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4e436-0a8a-4b52-9521-8eb12252c32e None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:46.966211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12099ce4-f827-4682-97a2-9f7062ed6474 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:46.988792 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4e436-0a8a-4b52-9521-8eb12252c32e None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:46.989735 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:47.011209 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b99e-49dd-4a0f-8a24-c2bc5ef242bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:47.011802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b99e-49dd-4a0f-8a24-c2bc5ef242bb None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:47.012169 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b99e-49dd-4a0f-8a24-c2bc5ef242bb None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:47.012557 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b99e-49dd-4a0f-8a24-c2bc5ef242bb None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:47.013295 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988b99e-49dd-4a0f-8a24-c2bc5ef242bb None admin] RBAC: Adding query filter params (name=network) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:47.013741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988b99e-49dd-4a0f-8a24-c2bc5ef242bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:47.015708 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988b99e-49dd-4a0f-8a24-c2bc5ef242bb None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:47.026028 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 375/739] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:39:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:47.030278 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b99e-49dd-4a0f-8a24-c2bc5ef242bb None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:47.040597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977797e-2fa3-465a-85bf-7ca62270ee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:47.041711 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977797e-2fa3-465a-85bf-7ca62270ee80 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:47.042205 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977797e-2fa3-465a-85bf-7ca62270ee80 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:47.042864 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977797e-2fa3-465a-85bf-7ca62270ee80 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:47.043889 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977797e-2fa3-465a-85bf-7ca62270ee80 None admin] RBAC: Adding query filter params (type=image) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:47.044394 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977797e-2fa3-465a-85bf-7ca62270ee80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:47.046169 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977797e-2fa3-465a-85bf-7ca62270ee80 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:47.054679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 365/740] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:47.060452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977797e-2fa3-465a-85bf-7ca62270ee80 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:47.135348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:47.174391 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b99e-49dd-4a0f-8a24-c2bc5ef242bb None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:47.193058 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977797e-2fa3-465a-85bf-7ca62270ee80 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:47.220988 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf59ef-91ce-4156-aea5-8714e6fe63e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:47.221713 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf59ef-91ce-4156-aea5-8714e6fe63e5 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:47.222122 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf59ef-91ce-4156-aea5-8714e6fe63e5 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:47.222499 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf59ef-91ce-4156-aea5-8714e6fe63e5 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:47.223293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf59ef-91ce-4156-aea5-8714e6fe63e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:47.223690 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf59ef-91ce-4156-aea5-8714e6fe63e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:47.225189 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf59ef-91ce-4156-aea5-8714e6fe63e5 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:47.237500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 376/741] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:39:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:47.240374 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf59ef-91ce-4156-aea5-8714e6fe63e5 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:47.248729 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7f587-1dd6-41df-a781-0025c30a2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:47.249362 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7f587-1dd6-41df-a781-0025c30a2e96 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:47.249703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7f587-1dd6-41df-a781-0025c30a2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:47.250019 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7f587-1dd6-41df-a781-0025c30a2e96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:47.250996 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7f587-1dd6-41df-a781-0025c30a2e96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:47.253024 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7f587-1dd6-41df-a781-0025c30a2e96 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:47.292983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 366/742] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:39:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 14:39:47.322482 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:47.408197 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf59ef-91ce-4156-aea5-8714e6fe63e5 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:47.464582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6acdb3-8a18-42c4-8f15-5bd61d63ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:47.465215 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6acdb3-8a18-42c4-8f15-5bd61d63ae56 None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:47.465491 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6acdb3-8a18-42c4-8f15-5bd61d63ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:47.465804 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6acdb3-8a18-42c4-8f15-5bd61d63ae56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:47.466516 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6acdb3-8a18-42c4-8f15-5bd61d63ae56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:47.467909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6acdb3-8a18-42c4-8f15-5bd61d63ae56 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:47.500434 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 377/743] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:39:47 2022] POST /identity/v3/endpoints => generated 337 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:39:47.928520 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5908df-c6ce-4119-9514-a89123b01ac9 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:47.929066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5908df-c6ce-4119-9514-a89123b01ac9 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:47.929454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5908df-c6ce-4119-9514-a89123b01ac9 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:47.933040 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 367/744] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:47.939225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a81fa2-16a3-4624-bad4-7fd110410a70 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:47.940309 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a81fa2-16a3-4624-bad4-7fd110410a70 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:47.940448 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a81fa2-16a3-4624-bad4-7fd110410a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:47.963095 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-f2a81fa2-16a3-4624-bad4-7fd110410a70 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:47.964804 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-f2a81fa2-16a3-4624-bad4-7fd110410a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:48.060879 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 378/745] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:47 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:39:48.398000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5908df-c6ce-4119-9514-a89123b01ac9 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:48.517157 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5908df-c6ce-4119-9514-a89123b01ac9 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:48.534184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:48.562119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40de598-fd3c-4eda-8297-043e3167cd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:48.562770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40de598-fd3c-4eda-8297-043e3167cd33 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:48.563043 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40de598-fd3c-4eda-8297-043e3167cd33 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:48.563310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40de598-fd3c-4eda-8297-043e3167cd33 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:48.563909 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40de598-fd3c-4eda-8297-043e3167cd33 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:48.565625 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40de598-fd3c-4eda-8297-043e3167cd33 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-a40de598-fd3c-4eda-8297-043e3167cd33 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:48.575404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:48.576524 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 14:39:48.577460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:48.581551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 368/746] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Aug 19 14:39:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:48.583450 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a81fa2-16a3-4624-bad4-7fd110410a70 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:48.621881 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:48.698621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e298-f26f-4820-8e91-8f9ae7dca55b None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:48.698907 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e298-f26f-4820-8e91-8f9ae7dca55b None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:48.699057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e298-f26f-4820-8e91-8f9ae7dca55b None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:48.700581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 369/747] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:48.705631 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a0fa-4db3-485c-b9e1-3ea5d496d6f1 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:48.705978 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a0fa-4db3-485c-b9e1-3ea5d496d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:48.706225 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a0fa-4db3-485c-b9e1-3ea5d496d6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:48.726463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-2ca3a0fa-4db3-485c-b9e1-3ea5d496d6f1 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:48.728089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-2ca3a0fa-4db3-485c-b9e1-3ea5d496d6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:48.746766 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a81fa2-16a3-4624-bad4-7fd110410a70 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:48.793841 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750aa1b-2a33-44b4-9810-1202d3ef65b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:48.794692 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750aa1b-2a33-44b4-9810-1202d3ef65b3 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:48.795042 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750aa1b-2a33-44b4-9810-1202d3ef65b3 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:48.795311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750aa1b-2a33-44b4-9810-1202d3ef65b3 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:48.796200 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750aa1b-2a33-44b4-9810-1202d3ef65b3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:48.796624 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750aa1b-2a33-44b4-9810-1202d3ef65b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:48.798665 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750aa1b-2a33-44b4-9810-1202d3ef65b3 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:48.810181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 379/748] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 14:39:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:48.811535 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750aa1b-2a33-44b4-9810-1202d3ef65b3 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:48.839430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 370/749] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:48 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 14:39:48.927232 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:48.949701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750aa1b-2a33-44b4-9810-1202d3ef65b3 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:49.009627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bc098-e80d-4da0-a265-669ac8c7eb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:49.010683 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bc098-e80d-4da0-a265-669ac8c7eb7f None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:49.011157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bc098-e80d-4da0-a265-669ac8c7eb7f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:49.011649 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bc098-e80d-4da0-a265-669ac8c7eb7f None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:49.012740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bc098-e80d-4da0-a265-669ac8c7eb7f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:49.013262 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bc098-e80d-4da0-a265-669ac8c7eb7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:49.015851 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bc098-e80d-4da0-a265-669ac8c7eb7f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:49.030008 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 380/750] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 14:39:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:49.178499 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3a0fa-4db3-485c-b9e1-3ea5d496d6f1 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:49.305211 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3a0fa-4db3-485c-b9e1-3ea5d496d6f1 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:49.316625 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:49.353906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e02ef-5603-4eec-a314-caebbd0fdd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:49.354899 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e02ef-5603-4eec-a314-caebbd0fdd02 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:49.355352 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e02ef-5603-4eec-a314-caebbd0fdd02 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:49.355856 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e02ef-5603-4eec-a314-caebbd0fdd02 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:49.356773 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e02ef-5603-4eec-a314-caebbd0fdd02 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:49.358922 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e02ef-5603-4eec-a314-caebbd0fdd02 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-f23e02ef-5603-4eec-a314-caebbd0fdd02 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:49.372367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:49.373410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:49.374310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 371/751] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:49.383205 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bc098-e80d-4da0-a265-669ac8c7eb7f None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:49.510831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bc098-e80d-4da0-a265-669ac8c7eb7f None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:49.551150 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35475a-5e10-4eb5-b6fd-7e8d24b799e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:49.551556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35475a-5e10-4eb5-b6fd-7e8d24b799e7 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:49.552283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35475a-5e10-4eb5-b6fd-7e8d24b799e7 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:49.552283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35475a-5e10-4eb5-b6fd-7e8d24b799e7 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:49.552679 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35475a-5e10-4eb5-b6fd-7e8d24b799e7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:49.552679 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35475a-5e10-4eb5-b6fd-7e8d24b799e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:49.554377 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35475a-5e10-4eb5-b6fd-7e8d24b799e7 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:49.560269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 381/752] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:49.565978 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e02ef-5603-4eec-a314-caebbd0fdd02 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:49.722795 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e02ef-5603-4eec-a314-caebbd0fdd02 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:49.779778 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295ab5c-2bd9-4c31-8113-d15e4efdee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:49.780773 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ab5c-2bd9-4c31-8113-d15e4efdee07 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:49.781242 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ab5c-2bd9-4c31-8113-d15e4efdee07 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:49.781755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ab5c-2bd9-4c31-8113-d15e4efdee07 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:49.782844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295ab5c-2bd9-4c31-8113-d15e4efdee07 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:49.783271 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295ab5c-2bd9-4c31-8113-d15e4efdee07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:49.785349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295ab5c-2bd9-4c31-8113-d15e4efdee07 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:49.792263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 372/753] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:49.804752 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11394d7b-14a6-4890-8dda-cc4b6744b50b None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:49.805039 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11394d7b-14a6-4890-8dda-cc4b6744b50b None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:49.805651 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11394d7b-14a6-4890-8dda-cc4b6744b50b None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:49.807988 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 382/754] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:49.814194 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d41b1-520f-4ad5-8fc1-da1e3cf0dde9 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:49.814380 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d41b1-520f-4ad5-8fc1-da1e3cf0dde9 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:49.814961 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d41b1-520f-4ad5-8fc1-da1e3cf0dde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:49.834797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-8e1d41b1-520f-4ad5-8fc1-da1e3cf0dde9 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:49.836000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-8e1d41b1-520f-4ad5-8fc1-da1e3cf0dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:49.870416 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:49.916596 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 373/755] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:49 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 14:39:50.256622 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11394d7b-14a6-4890-8dda-cc4b6744b50b None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:50.282186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:50.413063 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11394d7b-14a6-4890-8dda-cc4b6744b50b None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:50.458956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d36348-81f3-4b59-8878-f2f2487f2586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:50.460088 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d36348-81f3-4b59-8878-f2f2487f2586 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:50.460533 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d36348-81f3-4b59-8878-f2f2487f2586 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:50.461092 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d36348-81f3-4b59-8878-f2f2487f2586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:50.569228 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d36348-81f3-4b59-8878-f2f2487f2586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:50.570952 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d36348-81f3-4b59-8878-f2f2487f2586 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:50.593992 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:50.704779 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 383/756] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:39:50 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 14:39:50.710935 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d41b1-520f-4ad5-8fc1-da1e3cf0dde9 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:50.836768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d41b1-520f-4ad5-8fc1-da1e3cf0dde9 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:50.878174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0d6ac-4ef5-4809-8f50-023b55dbb345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:50.878804 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0d6ac-4ef5-4809-8f50-023b55dbb345 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:50.879213 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0d6ac-4ef5-4809-8f50-023b55dbb345 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:50.879676 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0d6ac-4ef5-4809-8f50-023b55dbb345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:50.896681 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0d6ac-4ef5-4809-8f50-023b55dbb345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:50.899000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0d6ac-4ef5-4809-8f50-023b55dbb345 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-d3e0d6ac-4ef5-4809-8f50-023b55dbb345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:39:50.923965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:50.924997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:39:50.925892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:39:50.925892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:39:50.925892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:50.925892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 374/757] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:50.935046 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d36348-81f3-4b59-8878-f2f2487f2586 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:51.078131 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d36348-81f3-4b59-8878-f2f2487f2586 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:51.104495 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:51.131061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5ae99-06b1-47b8-a475-f3c91687efdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:51.131826 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5ae99-06b1-47b8-a475-f3c91687efdd None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:51.132200 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5ae99-06b1-47b8-a475-f3c91687efdd None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:51.132547 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5ae99-06b1-47b8-a475-f3c91687efdd None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:51.133748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5ae99-06b1-47b8-a475-f3c91687efdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:51.135003 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5ae99-06b1-47b8-a475-f3c91687efdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:51.136837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5ae99-06b1-47b8-a475-f3c91687efdd None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:51.156354 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 384/758] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:51.487174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96de5-328d-4705-bb40-ec1fea60574a None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:51.487543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96de5-328d-4705-bb40-ec1fea60574a None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:51.487720 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96de5-328d-4705-bb40-ec1fea60574a None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:51.489407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 375/759] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:51.494945 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145cbfd-23ea-47e4-aca0-1e5fc5ecc071 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:51.495431 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145cbfd-23ea-47e4-aca0-1e5fc5ecc071 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:51.495536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145cbfd-23ea-47e4-aca0-1e5fc5ecc071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:51.515956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-8145cbfd-23ea-47e4-aca0-1e5fc5ecc071 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:51.517257 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-8145cbfd-23ea-47e4-aca0-1e5fc5ecc071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:51.594523 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 385/760] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:51 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:39:51.937819 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96de5-328d-4705-bb40-ec1fea60574a None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:51.960890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:52.065627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96de5-328d-4705-bb40-ec1fea60574a None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:52.102601 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc322d43-25b5-44a9-b7cf-0820bd8913d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:52.103615 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc322d43-25b5-44a9-b7cf-0820bd8913d5 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:52.104077 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc322d43-25b5-44a9-b7cf-0820bd8913d5 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:52.104538 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc322d43-25b5-44a9-b7cf-0820bd8913d5 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:52.105707 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc322d43-25b5-44a9-b7cf-0820bd8913d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:52.108081 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc322d43-25b5-44a9-b7cf-0820bd8913d5 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:52.127808 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 376/761] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 14:39:51 2022] POST /identity/v3/services => generated 269 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:39:52.146137 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c1c8-760a-4103-9d5a-59635fd08238 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:52.146658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c1c8-760a-4103-9d5a-59635fd08238 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:52.147005 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c1c8-760a-4103-9d5a-59635fd08238 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:52.148928 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 386/762] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:52.155431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df98f2-0fb0-4a56-88b4-8170333fcfcb None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:52.155680 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df98f2-0fb0-4a56-88b4-8170333fcfcb None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:52.155957 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df98f2-0fb0-4a56-88b4-8170333fcfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:52.176104 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-72df98f2-0fb0-4a56-88b4-8170333fcfcb None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:52.177309 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-72df98f2-0fb0-4a56-88b4-8170333fcfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:52.268172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 377/763] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:52 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:39:52.600205 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282c1c8-760a-4103-9d5a-59635fd08238 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:52.716730 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282c1c8-760a-4103-9d5a-59635fd08238 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:52.730267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:52.760642 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a500675-799d-411b-9298-2938b1b9918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:52.761253 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a500675-799d-411b-9298-2938b1b9918c None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:52.761530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a500675-799d-411b-9298-2938b1b9918c None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:52.761781 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a500675-799d-411b-9298-2938b1b9918c None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:52.762451 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a500675-799d-411b-9298-2938b1b9918c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:52.763847 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a500675-799d-411b-9298-2938b1b9918c None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:52.782377 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 387/764] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 14:39:52 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:39:54.627513 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66eef7-b496-4870-87b6-b71b97035706 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:54.628063 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66eef7-b496-4870-87b6-b71b97035706 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:54.628063 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66eef7-b496-4870-87b6-b71b97035706 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:54.630076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 378/765] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:54.637310 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ecd0b-4fee-4755-a21d-6de2955f90bb None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:54.637310 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ecd0b-4fee-4755-a21d-6de2955f90bb None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:54.638300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ecd0b-4fee-4755-a21d-6de2955f90bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:54.661059 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-136ecd0b-4fee-4755-a21d-6de2955f90bb None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:54.662329 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-136ecd0b-4fee-4755-a21d-6de2955f90bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:54.767829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 388/766] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:54 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:39:55.093671 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac34eb7-8594-4e73-87a0-cc010993b8d7 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:55.094146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac34eb7-8594-4e73-87a0-cc010993b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:55.094625 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac34eb7-8594-4e73-87a0-cc010993b8d7 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:55.096412 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 379/767] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:39:55.099132 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ecd0b-4fee-4755-a21d-6de2955f90bb None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:55.102965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60522331-3b84-48dc-9366-401992d4e3bc None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:55.103526 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60522331-3b84-48dc-9366-401992d4e3bc None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:55.103851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60522331-3b84-48dc-9366-401992d4e3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:55.113504 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:55.130578 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-60522331-3b84-48dc-9366-401992d4e3bc None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:55.132422 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-60522331-3b84-48dc-9366-401992d4e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:55.222556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:55.235923 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ecd0b-4fee-4755-a21d-6de2955f90bb None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:55.236202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 380/768] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:55 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 14:39:55.279399 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fef603-ff5e-429e-91bf-dd002d14755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:55.280158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fef603-ff5e-429e-91bf-dd002d14755f None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:55.280530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fef603-ff5e-429e-91bf-dd002d14755f None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:55.280878 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fef603-ff5e-429e-91bf-dd002d14755f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:55.281618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fef603-ff5e-429e-91bf-dd002d14755f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:55.283189 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fef603-ff5e-429e-91bf-dd002d14755f None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-78fef603-ff5e-429e-91bf-dd002d14755f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:55.293065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:55.294206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:55.295157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 389/769] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Aug 19 14:39:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:39:55.300976 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60522331-3b84-48dc-9366-401992d4e3bc None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:55.455436 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60522331-3b84-48dc-9366-401992d4e3bc None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:55.497435 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c1f78-a6ae-490a-929e-001caacceb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:55.498479 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c1f78-a6ae-490a-929e-001caacceb2f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:55.498911 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c1f78-a6ae-490a-929e-001caacceb2f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:55.499333 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c1f78-a6ae-490a-929e-001caacceb2f None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:55.499995 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c1f78-a6ae-490a-929e-001caacceb2f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:55.500292 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c1f78-a6ae-490a-929e-001caacceb2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:55.501847 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c1f78-a6ae-490a-929e-001caacceb2f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:55.503293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:55.508219 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 381/770] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 14:39:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:55.516066 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fef603-ff5e-429e-91bf-dd002d14755f None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:55.587725 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c1f78-a6ae-490a-929e-001caacceb2f None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:55.653953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fef603-ff5e-429e-91bf-dd002d14755f None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:55.701679 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981da26a-7a4d-4466-a7ad-744657fd3739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:55.702360 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981da26a-7a4d-4466-a7ad-744657fd3739 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:55.702673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981da26a-7a4d-4466-a7ad-744657fd3739 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:55.702988 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981da26a-7a4d-4466-a7ad-744657fd3739 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:55.703633 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981da26a-7a4d-4466-a7ad-744657fd3739 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:55.703974 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981da26a-7a4d-4466-a7ad-744657fd3739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:55.704135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c1f78-a6ae-490a-929e-001caacceb2f None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:55.705884 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981da26a-7a4d-4466-a7ad-744657fd3739 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:55.715607 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 390/771] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 14:39:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:55.723602 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981da26a-7a4d-4466-a7ad-744657fd3739 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:55.748644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43813681-c4d3-4981-91b0-e9c312a6ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:55.749285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43813681-c4d3-4981-91b0-e9c312a6ec06 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:55.749557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43813681-c4d3-4981-91b0-e9c312a6ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:55.749828 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43813681-c4d3-4981-91b0-e9c312a6ec06 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:55.750456 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43813681-c4d3-4981-91b0-e9c312a6ec06 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:55.751828 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43813681-c4d3-4981-91b0-e9c312a6ec06 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:55.755624 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-43813681-c4d3-4981-91b0-e9c312a6ec06 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:55.761297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:55.762544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:55.763750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 382/772] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:39:55.769859 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43813681-c4d3-4981-91b0-e9c312a6ec06 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:55.848072 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:55.864335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981da26a-7a4d-4466-a7ad-744657fd3739 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:55.903238 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43813681-c4d3-4981-91b0-e9c312a6ec06 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:55.918767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e994e-1a5f-4876-89b7-b646a7f43d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:55.919563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e994e-1a5f-4876-89b7-b646a7f43d5e None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:55.919844 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e994e-1a5f-4876-89b7-b646a7f43d5e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:55.920365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e994e-1a5f-4876-89b7-b646a7f43d5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:55.921395 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e994e-1a5f-4876-89b7-b646a7f43d5e None admin] RBAC: Adding query filter params (interface=public, service_id=b675485dd19a449296dda26df89cce89, region_id=RegionOne) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:55.921935 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e994e-1a5f-4876-89b7-b646a7f43d5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:55.924336 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e994e-1a5f-4876-89b7-b646a7f43d5e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:55.932926 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 391/773] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 14:39:55 2022] GET /identity/v3/endpoints?service_id=b675485dd19a449296dda26df89cce89&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:55.940510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e994e-1a5f-4876-89b7-b646a7f43d5e None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:55.942800 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9d757-94c6-4a77-8f94-220412f664fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:55.943490 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9d757-94c6-4a77-8f94-220412f664fa None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:55.943831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9d757-94c6-4a77-8f94-220412f664fa None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:55.944193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9d757-94c6-4a77-8f94-220412f664fa None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:55.944951 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9d757-94c6-4a77-8f94-220412f664fa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:55.945462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9d757-94c6-4a77-8f94-220412f664fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:55.947630 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9d757-94c6-4a77-8f94-220412f664fa None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:55.953106 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 383/774] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:55.959163 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9d757-94c6-4a77-8f94-220412f664fa None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:56.062697 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:56.087140 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e994e-1a5f-4876-89b7-b646a7f43d5e None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:56.109438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9d757-94c6-4a77-8f94-220412f664fa None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:56.141249 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58017140-815e-4e6d-be79-d5655dfc1ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:56.141946 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58017140-815e-4e6d-be79-d5655dfc1ce2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:56.142257 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58017140-815e-4e6d-be79-d5655dfc1ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:56.142530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58017140-815e-4e6d-be79-d5655dfc1ce2 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:56.143146 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58017140-815e-4e6d-be79-d5655dfc1ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:56.143295 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:56.144658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58017140-815e-4e6d-be79-d5655dfc1ce2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:56.169280 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 392/775] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 14:39:55 2022] GET /identity/v3/services => generated 1498 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 14:39:56.169489 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbeb8b-c612-42f1-a20b-b746d9a392da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:56.169489 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbeb8b-c612-42f1-a20b-b746d9a392da None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:56.169489 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbeb8b-c612-42f1-a20b-b746d9a392da None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:56.169489 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbeb8b-c612-42f1-a20b-b746d9a392da None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:56.169848 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbeb8b-c612-42f1-a20b-b746d9a392da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:56.169848 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbeb8b-c612-42f1-a20b-b746d9a392da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:56.169848 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbeb8b-c612-42f1-a20b-b746d9a392da None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:56.181451 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 384/776] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:39:56.192797 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58017140-815e-4e6d-be79-d5655dfc1ce2 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:56.331605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58017140-815e-4e6d-be79-d5655dfc1ce2 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:56.385081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350b9cb-0a96-4277-9370-201bb42d1191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:56.385720 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350b9cb-0a96-4277-9370-201bb42d1191 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:56.386449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350b9cb-0a96-4277-9370-201bb42d1191 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:56.386449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350b9cb-0a96-4277-9370-201bb42d1191 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:56.387016 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350b9cb-0a96-4277-9370-201bb42d1191 None admin] RBAC: Adding query filter params (interface=public, service_id=f82636b6da7a4b6bb68e3466ac867d78, region_id=RegionOne) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:56.387319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350b9cb-0a96-4277-9370-201bb42d1191 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:56.388716 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350b9cb-0a96-4277-9370-201bb42d1191 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:56.394859 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 393/777] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 14:39:56 2022] GET /identity/v3/endpoints?service_id=f82636b6da7a4b6bb68e3466ac867d78&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:56.401844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbeb8b-c612-42f1-a20b-b746d9a392da None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:56.520866 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbeb8b-c612-42f1-a20b-b746d9a392da None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:56.560983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8df9a-57f9-4db7-be83-481ece7d4ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:56.562144 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8df9a-57f9-4db7-be83-481ece7d4ec8 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:56.563252 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8df9a-57f9-4db7-be83-481ece7d4ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:56.564275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8df9a-57f9-4db7-be83-481ece7d4ec8 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:56.565225 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8df9a-57f9-4db7-be83-481ece7d4ec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:56.567584 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8df9a-57f9-4db7-be83-481ece7d4ec8 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:56.574497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 385/778] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 14:39:56 2022] GET /identity/v3/services => generated 1498 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 14:39:58.470839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dacb51-4781-4265-8a7f-3f580a3f4da6 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:58.471420 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dacb51-4781-4265-8a7f-3f580a3f4da6 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:58.471420 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dacb51-4781-4265-8a7f-3f580a3f4da6 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:58.472710 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 394/779] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:58.478371 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886064c-7ae9-4ed0-8866-a96b1ea1e17c None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:58.478874 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886064c-7ae9-4ed0-8866-a96b1ea1e17c None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:58.478874 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886064c-7ae9-4ed0-8866-a96b1ea1e17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:58.498136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-3886064c-7ae9-4ed0-8866-a96b1ea1e17c None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:58.499326 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-3886064c-7ae9-4ed0-8866-a96b1ea1e17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:58.553649 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:58.572589 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 386/780] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:58 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:39:58.886042 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045345d7-0a05-4892-b555-9839e06b5be3 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:58.886334 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045345d7-0a05-4892-b555-9839e06b5be3 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:58.886760 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045345d7-0a05-4892-b555-9839e06b5be3 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:58.888120 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 395/781] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:39:58.893773 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1975b-3f19-4cd1-9772-af9ed93e8b23 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:58.894096 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1975b-3f19-4cd1-9772-af9ed93e8b23 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:58.894369 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1975b-3f19-4cd1-9772-af9ed93e8b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:58.908814 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045345d7-0a05-4892-b555-9839e06b5be3 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:58.916823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-c7d1975b-3f19-4cd1-9772-af9ed93e8b23 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:39:58.918083 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c7d1975b-3f19-4cd1-9772-af9ed93e8b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:39:58.924949 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:58.987195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 387/782] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:39:58 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:39:59.017176 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045345d7-0a05-4892-b555-9839e06b5be3 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:59.050791 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e4687-e7a5-4bc1-8ab2-9ae62aa7f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:59.051424 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e4687-e7a5-4bc1-8ab2-9ae62aa7f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:59.051695 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e4687-e7a5-4bc1-8ab2-9ae62aa7f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:59.051959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e4687-e7a5-4bc1-8ab2-9ae62aa7f7a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:59.052536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e4687-e7a5-4bc1-8ab2-9ae62aa7f7a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:59.053922 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e4687-e7a5-4bc1-8ab2-9ae62aa7f7a4 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-3c3e4687-e7a5-4bc1-8ab2-9ae62aa7f7a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:59.062741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:59.063673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:39:59.065454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 396/783] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Aug 19 14:39:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:39:59.070325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1975b-3f19-4cd1-9772-af9ed93e8b23 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:59.176933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1975b-3f19-4cd1-9772-af9ed93e8b23 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:59.192131 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:59.214336 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7bc5-4fc3-452a-9f28-2532e570a9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:59.214951 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7bc5-4fc3-452a-9f28-2532e570a9f3 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:59.215220 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7bc5-4fc3-452a-9f28-2532e570a9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:59.215488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7bc5-4fc3-452a-9f28-2532e570a9f3 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:59.216119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac7bc5-4fc3-452a-9f28-2532e570a9f3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:59.216412 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac7bc5-4fc3-452a-9f28-2532e570a9f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:59.217778 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac7bc5-4fc3-452a-9f28-2532e570a9f3 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:59.228020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 388/784] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 14:39:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:59.229295 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e4687-e7a5-4bc1-8ab2-9ae62aa7f7a4 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:59.306846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:59.313456 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7bc5-4fc3-452a-9f28-2532e570a9f3 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:59.331702 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e4687-e7a5-4bc1-8ab2-9ae62aa7f7a4 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:59.365771 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da08ff0-0b1b-493e-a5d7-2a4bea6888fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:59.366411 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da08ff0-0b1b-493e-a5d7-2a4bea6888fa None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:59.366684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da08ff0-0b1b-493e-a5d7-2a4bea6888fa None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:59.366950 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da08ff0-0b1b-493e-a5d7-2a4bea6888fa None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:59.367584 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da08ff0-0b1b-493e-a5d7-2a4bea6888fa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:59.368219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da08ff0-0b1b-493e-a5d7-2a4bea6888fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:59.369612 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da08ff0-0b1b-493e-a5d7-2a4bea6888fa None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:59.374935 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 397/785] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Aug 19 14:39:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:59.380573 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da08ff0-0b1b-493e-a5d7-2a4bea6888fa None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:59.422401 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7bc5-4fc3-452a-9f28-2532e570a9f3 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:59.457840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022f607-010a-4089-99a7-885abea9dc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:59.458418 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022f607-010a-4089-99a7-885abea9dc34 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:59.458687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022f607-010a-4089-99a7-885abea9dc34 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:59.458938 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022f607-010a-4089-99a7-885abea9dc34 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:59.459505 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022f607-010a-4089-99a7-885abea9dc34 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:59.460854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022f607-010a-4089-99a7-885abea9dc34 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-b022f607-010a-4089-99a7-885abea9dc34 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:39:59.470344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:39:59.471390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:39:59.472216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 389/786] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:39:59.477736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022f607-010a-4089-99a7-885abea9dc34 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:59.488048 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da08ff0-0b1b-493e-a5d7-2a4bea6888fa None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:59.523538 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:59.526995 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa417ce3-8224-4d6d-9c28-f76fa3466ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:59.527396 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa417ce3-8224-4d6d-9c28-f76fa3466ae6 None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:59.527661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa417ce3-8224-4d6d-9c28-f76fa3466ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:59.527922 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa417ce3-8224-4d6d-9c28-f76fa3466ae6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:59.528582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa417ce3-8224-4d6d-9c28-f76fa3466ae6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:59.529971 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa417ce3-8224-4d6d-9c28-f76fa3466ae6 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:59.539329 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:59.552261 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 398/787] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:39:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 14:39:59.589683 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022f607-010a-4089-99a7-885abea9dc34 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:59.641859 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacce84-6e1d-453f-8a84-1cd0462e2801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:59.642517 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacce84-6e1d-453f-8a84-1cd0462e2801 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:59.642814 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacce84-6e1d-453f-8a84-1cd0462e2801 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:59.643083 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacce84-6e1d-453f-8a84-1cd0462e2801 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:59.643724 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacce84-6e1d-453f-8a84-1cd0462e2801 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:59.644029 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacce84-6e1d-453f-8a84-1cd0462e2801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:59.645439 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacce84-6e1d-453f-8a84-1cd0462e2801 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:59.651736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 390/788] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:59.657751 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa417ce3-8224-4d6d-9c28-f76fa3466ae6 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:59.770705 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa417ce3-8224-4d6d-9c28-f76fa3466ae6 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:59.808017 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2f1a0-666e-420b-8918-f31e4e5f51e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:59.808676 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2f1a0-666e-420b-8918-f31e4e5f51e2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:59.808970 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2f1a0-666e-420b-8918-f31e4e5f51e2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:59.809262 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2f1a0-666e-420b-8918-f31e4e5f51e2 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:39:59.809899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2f1a0-666e-420b-8918-f31e4e5f51e2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:39:59.810229 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2f1a0-666e-420b-8918-f31e4e5f51e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:39:59.811740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2f1a0-666e-420b-8918-f31e4e5f51e2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:39:59.817428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 399/789] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Aug 19 14:39:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:39:59.823503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacce84-6e1d-453f-8a84-1cd0462e2801 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:39:59.959843 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacce84-6e1d-453f-8a84-1cd0462e2801 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:39:59.961421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:39:59.998664 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56034f-8375-4c63-a304-6dc6b1a0b15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:39:59.999307 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56034f-8375-4c63-a304-6dc6b1a0b15c None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:39:59.999581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56034f-8375-4c63-a304-6dc6b1a0b15c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:39:59.999848 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56034f-8375-4c63-a304-6dc6b1a0b15c None admin] PATH_INFO: `/v3/endpoints` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:00.000505 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56034f-8375-4c63-a304-6dc6b1a0b15c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:00.001863 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56034f-8375-4c63-a304-6dc6b1a0b15c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:00.024233 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 391/790] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:39:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:40:01.774490 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9faf-7ca7-448e-a13c-a3071351c9d2 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:01.775031 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9faf-7ca7-448e-a13c-a3071351c9d2 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:01.775031 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9faf-7ca7-448e-a13c-a3071351c9d2 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:01.776355 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 400/791] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:40:01.782132 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509db54-3ec6-4e61-b1eb-48339eb3f8bd None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:01.782560 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509db54-3ec6-4e61-b1eb-48339eb3f8bd None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:01.782716 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509db54-3ec6-4e61-b1eb-48339eb3f8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:01.802170 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-0509db54-3ec6-4e61-b1eb-48339eb3f8bd None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:40:01.803365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-0509db54-3ec6-4e61-b1eb-48339eb3f8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:40:01.882341 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 392/792] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:40:01 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:40:02.210739 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d9faf-7ca7-448e-a13c-a3071351c9d2 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:02.245905 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f88d-3ca6-4f17-8fee-63acdeae8c1d None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:02.246208 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f88d-3ca6-4f17-8fee-63acdeae8c1d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:02.246517 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f88d-3ca6-4f17-8fee-63acdeae8c1d None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:02.247823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 393/793] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:40:02.252939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517cee7-3a58-4d0e-a8be-666ee315073b None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:02.253279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517cee7-3a58-4d0e-a8be-666ee315073b None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:02.253549 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517cee7-3a58-4d0e-a8be-666ee315073b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:02.271971 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-f517cee7-3a58-4d0e-a8be-666ee315073b None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:40:02.273151 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-f517cee7-3a58-4d0e-a8be-666ee315073b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:40:02.277710 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:02.320900 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d9faf-7ca7-448e-a13c-a3071351c9d2 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:02.342414 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 394/794] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:40:02 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 14:40:02.355472 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaef617-b296-49ef-a0ff-742db7288b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:02.356109 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaef617-b296-49ef-a0ff-742db7288b7e None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:02.356381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaef617-b296-49ef-a0ff-742db7288b7e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:02.356663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaef617-b296-49ef-a0ff-742db7288b7e None admin] PATH_INFO: `/v3/services/compute` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:02.357227 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaef617-b296-49ef-a0ff-742db7288b7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:02.358641 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaef617-b296-49ef-a0ff-742db7288b7e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-efaef617-b296-49ef-a0ff-742db7288b7e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:40:02.367845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:40:02.370279 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:40:02.371187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 401/795] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:40:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:40:02.375223 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517cee7-3a58-4d0e-a8be-666ee315073b None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:02.392430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:02.479593 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517cee7-3a58-4d0e-a8be-666ee315073b None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:02.516070 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ecf27-d6a3-4f62-bf11-5fbfe4dd69fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:02.516682 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ecf27-d6a3-4f62-bf11-5fbfe4dd69fa None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:02.516954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ecf27-d6a3-4f62-bf11-5fbfe4dd69fa None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:02.517224 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ecf27-d6a3-4f62-bf11-5fbfe4dd69fa None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:02.517862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ecf27-d6a3-4f62-bf11-5fbfe4dd69fa None admin] RBAC: Adding query filter params (name=compute) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:40:02.518173 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ecf27-d6a3-4f62-bf11-5fbfe4dd69fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:02.519550 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ecf27-d6a3-4f62-bf11-5fbfe4dd69fa None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:02.524740 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 395/796] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:40:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:40:02.530568 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaef617-b296-49ef-a0ff-742db7288b7e None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:02.647459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaef617-b296-49ef-a0ff-742db7288b7e None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:02.666841 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ecf27-d6a3-4f62-bf11-5fbfe4dd69fa None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:02.676371 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:02.693939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc334c-e834-4bed-8e71-85ebe6d4b4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:02.694590 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc334c-e834-4bed-8e71-85ebe6d4b4a2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:02.694857 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc334c-e834-4bed-8e71-85ebe6d4b4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:02.695128 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc334c-e834-4bed-8e71-85ebe6d4b4a2 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:02.695758 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc334c-e834-4bed-8e71-85ebe6d4b4a2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:40:02.696054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc334c-e834-4bed-8e71-85ebe6d4b4a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:02.697495 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc334c-e834-4bed-8e71-85ebe6d4b4a2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:02.702583 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 402/797] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:40:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:40:02.757365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:02.783116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ecf27-d6a3-4f62-bf11-5fbfe4dd69fa None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:02.825608 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:02.826284 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:02.826564 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:02.826832 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:02.827497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:02.828967 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:02.831766 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: WARNING keystone.server.flask.common [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 14:40:02.852712 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.sql.core [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 14:40:02.852712 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 14:40:02.852712 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [parameters: {'id': 'caadbaedf0b040b4a5d75183db5dcb2d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 14:40:02.852712 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99834) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id caadbaedf0b040b4a5d75183db5dcb2d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id caadbaedf0b040b4a5d75183db5dcb2d. Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application conn.query(q) Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 14:40:02.871941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application result.read() Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 14:40:02.872886 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application next(self.gen) Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application yield resource Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application next(self.gen) Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise self.value Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application session.commit() Aug 19 14:40:02.873831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self.session.flush() Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application compat.raise_( Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 14:40:02.874917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 14:40:02.876319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application conn.query(q) Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application result.read() Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 14:40:02.877488 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [parameters: {'id': 'caadbaedf0b040b4a5d75183db5dcb2d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:02.878672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:40:02.879644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:40:02.880930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:40:02.880930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 14:40:02.880930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 14:40:02.880930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:40:02.880930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:40:02.880930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 14:40:02.880930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 14:40:02.880930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id caadbaedf0b040b4a5d75183db5dcb2d. Aug 19 14:40:02.880930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:02.880930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 396/798] 10.222.0.60 () {60 vars in 1140 bytes} [Fri Aug 19 14:40:02 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:40:02.882443 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc334c-e834-4bed-8e71-85ebe6d4b4a2 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:03.002899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc334c-e834-4bed-8e71-85ebe6d4b4a2 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:03.043233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbb74a-dbf0-49fa-b23a-1248a0d0aede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:03.043772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb74a-dbf0-49fa-b23a-1248a0d0aede None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:03.044056 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb74a-dbf0-49fa-b23a-1248a0d0aede None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:03.044321 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb74a-dbf0-49fa-b23a-1248a0d0aede None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:03.051853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbb74a-dbf0-49fa-b23a-1248a0d0aede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:03.053325 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbb74a-dbf0-49fa-b23a-1248a0d0aede None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-bfcbb74a-dbf0-49fa-b23a-1248a0d0aede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:40:03.065953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:40:03.068233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:40:03.070506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:40:03.070506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:40:03.070506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:40:03.070506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:40:03.070506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:40:03.070506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:40:03.070506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:40:03.070506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:40:03.070506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 403/799] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:40:03.075483 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:03.183360 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14f1f5-71b8-460f-9314-8610ae10d31b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:03.220066 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b27e1-c2a1-441b-80e9-e5b7d262c386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:03.220722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b27e1-c2a1-441b-80e9-e5b7d262c386 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:03.221000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b27e1-c2a1-441b-80e9-e5b7d262c386 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:03.221263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b27e1-c2a1-441b-80e9-e5b7d262c386 None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:03.221940 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b27e1-c2a1-441b-80e9-e5b7d262c386 None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:40:03.222264 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b27e1-c2a1-441b-80e9-e5b7d262c386 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:03.223913 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b27e1-c2a1-441b-80e9-e5b7d262c386 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:03.225684 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:03.248525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 397/800] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:40:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:40:05.326455 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9c1c-a678-4720-a48f-52924c1388c0 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:05.327393 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9c1c-a678-4720-a48f-52924c1388c0 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:05.327393 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9c1c-a678-4720-a48f-52924c1388c0 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:05.331821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 404/801] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:40:05.336020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f84cb-7d2f-40c8-a3f3-ffb1ffefb84d None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:05.336512 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f84cb-7d2f-40c8-a3f3-ffb1ffefb84d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:05.336803 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f84cb-7d2f-40c8-a3f3-ffb1ffefb84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:05.364827 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-0f7f84cb-7d2f-40c8-a3f3-ffb1ffefb84d None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:40:05.366941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-0f7f84cb-7d2f-40c8-a3f3-ffb1ffefb84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:40:05.470924 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 398/802] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:40:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:40:05.797763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c9c1c-a678-4720-a48f-52924c1388c0 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:05.854573 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:05.911125 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c9c1c-a678-4720-a48f-52924c1388c0 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:05.945006 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71faa083-1ba3-4bf0-a56c-5a4fc3524c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:05.945612 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faa083-1ba3-4bf0-a56c-5a4fc3524c09 None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:05.945883 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faa083-1ba3-4bf0-a56c-5a4fc3524c09 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:05.946232 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faa083-1ba3-4bf0-a56c-5a4fc3524c09 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:05.946858 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faa083-1ba3-4bf0-a56c-5a4fc3524c09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:05.948239 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faa083-1ba3-4bf0-a56c-5a4fc3524c09 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:05.965158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 405/803] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 14:40:05 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:40:05.968861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507ae1b-f813-44d3-b8f9-0b1593cd1bee None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:05.969141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507ae1b-f813-44d3-b8f9-0b1593cd1bee None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:05.969408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507ae1b-f813-44d3-b8f9-0b1593cd1bee None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:05.970947 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 399/804] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:40:05.976618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b792c-5ba1-4fc3-9583-bee1dae37862 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:05.976904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b792c-5ba1-4fc3-9583-bee1dae37862 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:05.977298 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b792c-5ba1-4fc3-9583-bee1dae37862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:05.997048 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-f87b792c-5ba1-4fc3-9583-bee1dae37862 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:40:05.998455 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-f87b792c-5ba1-4fc3-9583-bee1dae37862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:40:06.079095 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 406/805] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:40:05 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:40:06.405050 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507ae1b-f813-44d3-b8f9-0b1593cd1bee None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:06.512320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507ae1b-f813-44d3-b8f9-0b1593cd1bee None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:06.536933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:06.548135 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639936e-f3d5-4b2b-86cd-3695676a1e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:06.548748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639936e-f3d5-4b2b-86cd-3695676a1e14 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:06.549019 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639936e-f3d5-4b2b-86cd-3695676a1e14 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:06.549284 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639936e-f3d5-4b2b-86cd-3695676a1e14 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:06.549939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639936e-f3d5-4b2b-86cd-3695676a1e14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:06.551375 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639936e-f3d5-4b2b-86cd-3695676a1e14 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:06.567089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.sql.core [None req-e639936e-f3d5-4b2b-86cd-3695676a1e14 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 14:40:06.567089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 14:40:06.567089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [parameters: {'user_id': 'e3ec1cb455d24e8a8fab91136b585316', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 14:40:06.567089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99834) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-e639936e-f3d5-4b2b-86cd-3695676a1e14 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application conn.query(q) Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application result.read() Aug 19 14:40:06.574351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 14:40:06.575279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application next(self.gen) Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application yield resource Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application next(self.gen) Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise self.value Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application session.commit() Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 14:40:06.576293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self.session.flush() Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application compat.raise_( Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 14:40:06.577203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 14:40:06.578146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application conn.query(q) Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application result.read() Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 14:40:06.579013 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e3ec1cb455d24e8a8fab91136b585316', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:40:06.579890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 14:40:06.580797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 14:40:06.581743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 14:40:06.581743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 14:40:06.581743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 14:40:06.581743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 14:40:06.581743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 14:40:06.581743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:06.581743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 400/806] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Aug 19 14:40:06 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:40:06.584545 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b792c-5ba1-4fc3-9583-bee1dae37862 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:06.620175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:06.716028 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b792c-5ba1-4fc3-9583-bee1dae37862 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:06.773922 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da4406-c62f-4342-b5bf-f0fab544b3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:06.775246 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da4406-c62f-4342-b5bf-f0fab544b3fa None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:06.775697 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da4406-c62f-4342-b5bf-f0fab544b3fa None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:06.776100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da4406-c62f-4342-b5bf-f0fab544b3fa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:06.787135 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da4406-c62f-4342-b5bf-f0fab544b3fa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:06.789952 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da4406-c62f-4342-b5bf-f0fab544b3fa None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-51da4406-c62f-4342-b5bf-f0fab544b3fa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:40:06.810763 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:40:06.812586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:40:06.814454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 407/807] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:40:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:40:06.822076 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639936e-f3d5-4b2b-86cd-3695676a1e14 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:06.931753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639936e-f3d5-4b2b-86cd-3695676a1e14 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:06.976884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da305fb4-899b-4624-8072-6e0684a2353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:06.977580 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da305fb4-899b-4624-8072-6e0684a2353e None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:06.977870 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da305fb4-899b-4624-8072-6e0684a2353e None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:06.978260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da305fb4-899b-4624-8072-6e0684a2353e None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:06.979231 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da305fb4-899b-4624-8072-6e0684a2353e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:40:06.979231 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da305fb4-899b-4624-8072-6e0684a2353e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:06.980925 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da305fb4-899b-4624-8072-6e0684a2353e None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:07.023621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 401/808] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Aug 19 14:40:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:40:08.196656 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cfe25-4143-4eb2-a1cb-3b33663644f7 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:08.197297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cfe25-4143-4eb2-a1cb-3b33663644f7 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:08.197297 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cfe25-4143-4eb2-a1cb-3b33663644f7 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:08.199019 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 408/809] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:40:08.204829 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb97a6-00ad-421b-a914-d81d88cf4cc5 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:08.205291 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb97a6-00ad-421b-a914-d81d88cf4cc5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:08.205404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb97a6-00ad-421b-a914-d81d88cf4cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:08.226745 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-ffdb97a6-00ad-421b-a914-d81d88cf4cc5 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:40:08.228546 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-ffdb97a6-00ad-421b-a914-d81d88cf4cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:40:08.272924 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:08.302845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 402/810] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:40:08 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:40:08.625653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cfe25-4143-4eb2-a1cb-3b33663644f7 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:08.741653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:08.750636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cfe25-4143-4eb2-a1cb-3b33663644f7 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:08.786203 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c99257-b5eb-4d6b-811d-49c425a07b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:08.786853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c99257-b5eb-4d6b-811d-49c425a07b71 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:08.787127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c99257-b5eb-4d6b-811d-49c425a07b71 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:08.787390 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c99257-b5eb-4d6b-811d-49c425a07b71 None admin] PATH_INFO: `/v3/services/compute` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:08.787973 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c99257-b5eb-4d6b-811d-49c425a07b71 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:08.789379 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c99257-b5eb-4d6b-811d-49c425a07b71 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-e7c99257-b5eb-4d6b-811d-49c425a07b71 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:40:08.798684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:40:08.799775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:40:08.800627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 409/811] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:40:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:40:08.806747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb97a6-00ad-421b-a914-d81d88cf4cc5 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:08.929667 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb97a6-00ad-421b-a914-d81d88cf4cc5 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:08.972472 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f4bec-b8ce-427f-8604-09d9ed6b3494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:08.973136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f4bec-b8ce-427f-8604-09d9ed6b3494 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:08.973446 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f4bec-b8ce-427f-8604-09d9ed6b3494 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:08.973790 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f4bec-b8ce-427f-8604-09d9ed6b3494 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:08.974531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f4bec-b8ce-427f-8604-09d9ed6b3494 None admin] RBAC: Adding query filter params (name=compute) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:40:08.974896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f4bec-b8ce-427f-8604-09d9ed6b3494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:08.976478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f4bec-b8ce-427f-8604-09d9ed6b3494 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:08.982498 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 403/812] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:40:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:40:08.988475 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c99257-b5eb-4d6b-811d-49c425a07b71 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:09.102775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c99257-b5eb-4d6b-811d-49c425a07b71 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:09.156516 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cd970-f741-4cb8-9fc4-7ff4d992018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:09.157250 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd970-f741-4cb8-9fc4-7ff4d992018c None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:09.157567 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd970-f741-4cb8-9fc4-7ff4d992018c None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:09.157881 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd970-f741-4cb8-9fc4-7ff4d992018c None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:09.158657 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cd970-f741-4cb8-9fc4-7ff4d992018c None admin] RBAC: Adding query filter params (type=compute) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:40:09.158986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cd970-f741-4cb8-9fc4-7ff4d992018c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:09.160578 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cd970-f741-4cb8-9fc4-7ff4d992018c None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:09.167024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 410/813] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:40:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:40:09.175467 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f4bec-b8ce-427f-8604-09d9ed6b3494 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:09.232660 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:09.303144 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f4bec-b8ce-427f-8604-09d9ed6b3494 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:09.343441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a51f9-4241-4138-ab3a-497a304031e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:09.343681 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a51f9-4241-4138-ab3a-497a304031e1 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:09.343926 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a51f9-4241-4138-ab3a-497a304031e1 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:09.344187 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a51f9-4241-4138-ab3a-497a304031e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:09.344900 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a51f9-4241-4138-ab3a-497a304031e1 None admin] RBAC: Adding query filter params (interface=public, service_id=ef7a8260107e49e688f409a67358a392, region_id=RegionOne) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:40:09.345201 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a51f9-4241-4138-ab3a-497a304031e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:09.346632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a51f9-4241-4138-ab3a-497a304031e1 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:09.355153 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 404/814] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 14:40:09 2022] GET /identity/v3/endpoints?service_id=ef7a8260107e49e688f409a67358a392&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:40:09.361284 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cd970-f741-4cb8-9fc4-7ff4d992018c None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:09.391774 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:09.485425 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cd970-f741-4cb8-9fc4-7ff4d992018c None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:09.522268 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22035cd-b729-461b-bc37-37f13fb3f94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:09.522880 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22035cd-b729-461b-bc37-37f13fb3f94d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:09.523140 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22035cd-b729-461b-bc37-37f13fb3f94d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:09.523385 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22035cd-b729-461b-bc37-37f13fb3f94d None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:09.524224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22035cd-b729-461b-bc37-37f13fb3f94d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:09.525623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22035cd-b729-461b-bc37-37f13fb3f94d None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:09.532631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 411/815] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 14:40:09 2022] GET /identity/v3/services => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:40:11.744259 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912966-2cd6-4510-abe7-84a84508eef5 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:11.744785 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912966-2cd6-4510-abe7-84a84508eef5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:11.744785 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912966-2cd6-4510-abe7-84a84508eef5 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:11.746086 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 405/816] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:40:11.751951 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409a66-ea0d-4090-95c9-7c6ba8ebcf3f None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:11.752393 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409a66-ea0d-4090-95c9-7c6ba8ebcf3f None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:11.752480 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409a66-ea0d-4090-95c9-7c6ba8ebcf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:11.772116 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-2a409a66-ea0d-4090-95c9-7c6ba8ebcf3f None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:40:11.773330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-2a409a66-ea0d-4090-95c9-7c6ba8ebcf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:40:11.848662 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 412/817] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:40:11 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:40:12.172998 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99912966-2cd6-4510-abe7-84a84508eef5 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:12.282183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99912966-2cd6-4510-abe7-84a84508eef5 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:12.283754 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:12.320071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7be20-411e-4ede-aede-455029dc7503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:12.320706 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7be20-411e-4ede-aede-455029dc7503 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:12.321000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7be20-411e-4ede-aede-455029dc7503 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:12.321284 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7be20-411e-4ede-aede-455029dc7503 None admin] PATH_INFO: `/v3/services/compute` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:12.321861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7be20-411e-4ede-aede-455029dc7503 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:12.323267 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7be20-411e-4ede-aede-455029dc7503 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-2ba7be20-411e-4ede-aede-455029dc7503 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:40:12.332407 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:40:12.333527 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:40:12.334507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 406/818] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:40:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:40:12.340305 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a409a66-ea0d-4090-95c9-7c6ba8ebcf3f None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:12.358637 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:12.459657 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a409a66-ea0d-4090-95c9-7c6ba8ebcf3f None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:12.496160 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f14b-c04d-4667-9b96-8c1236831629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:12.496787 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f14b-c04d-4667-9b96-8c1236831629 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:12.497042 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f14b-c04d-4667-9b96-8c1236831629 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:12.497294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f14b-c04d-4667-9b96-8c1236831629 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:12.497967 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4f14b-c04d-4667-9b96-8c1236831629 None admin] RBAC: Adding query filter params (name=compute) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:40:12.498252 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4f14b-c04d-4667-9b96-8c1236831629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:12.499639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4f14b-c04d-4667-9b96-8c1236831629 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:12.504774 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 413/819] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:40:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:40:12.512051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7be20-411e-4ede-aede-455029dc7503 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:12.627565 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7be20-411e-4ede-aede-455029dc7503 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:12.666026 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f751b-0353-4a60-930e-c23ba2b81a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:12.666644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f751b-0353-4a60-930e-c23ba2b81a51 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:12.666913 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f751b-0353-4a60-930e-c23ba2b81a51 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:12.667172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f751b-0353-4a60-930e-c23ba2b81a51 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:12.667799 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f751b-0353-4a60-930e-c23ba2b81a51 None admin] RBAC: Adding query filter params (type=compute) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:40:12.668093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f751b-0353-4a60-930e-c23ba2b81a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:12.669468 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f751b-0353-4a60-930e-c23ba2b81a51 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:12.674969 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 407/820] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Aug 19 14:40:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:40:12.681568 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f14b-c04d-4667-9b96-8c1236831629 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:40:12.770319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:12.791269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f14b-c04d-4667-9b96-8c1236831629 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:40:12.825438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65cfd5-fc8a-4088-8ac9-5a900f1e990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:40:12.826071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65cfd5-fc8a-4088-8ac9-5a900f1e990e None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:40:12.826347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65cfd5-fc8a-4088-8ac9-5a900f1e990e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:40:12.826611 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65cfd5-fc8a-4088-8ac9-5a900f1e990e None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:40:12.827267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65cfd5-fc8a-4088-8ac9-5a900f1e990e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:40:12.828634 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65cfd5-fc8a-4088-8ac9-5a900f1e990e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:40:12.849438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 414/821] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:40:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:40:22.672325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=85 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:40:22.844984 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:18.377142 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c773f-ecd4-4b18-b84a-bd975b0c9df8 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:18.381166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c773f-ecd4-4b18-b84a-bd975b0c9df8 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:18.381166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c773f-ecd4-4b18-b84a-bd975b0c9df8 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:18.383224 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 408/822] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:41:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:41:18.389727 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404ecbc-827a-4a36-bede-a76732956f72 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:18.390536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404ecbc-827a-4a36-bede-a76732956f72 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:18.390536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404ecbc-827a-4a36-bede-a76732956f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:18.414157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-f404ecbc-827a-4a36-bede-a76732956f72 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:41:18.415470 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-f404ecbc-827a-4a36-bede-a76732956f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:41:18.533953 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 415/823] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:41:18 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:41:18.865947 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c773f-ecd4-4b18-b84a-bd975b0c9df8 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:19.040389 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c773f-ecd4-4b18-b84a-bd975b0c9df8 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:19.088917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77115bed-1719-44d1-a1c8-7e6388b56692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:19.090308 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77115bed-1719-44d1-a1c8-7e6388b56692 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:19.090665 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77115bed-1719-44d1-a1c8-7e6388b56692 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:19.090665 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77115bed-1719-44d1-a1c8-7e6388b56692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:19.118441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77115bed-1719-44d1-a1c8-7e6388b56692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:19.120011 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77115bed-1719-44d1-a1c8-7e6388b56692 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-77115bed-1719-44d1-a1c8-7e6388b56692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:19.139658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:19.141051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:19.142515 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:19.142515 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:19.142515 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:19.142515 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 409/824] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:19.147374 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404ecbc-827a-4a36-bede-a76732956f72 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:19.287042 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404ecbc-827a-4a36-bede-a76732956f72 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:19.327267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:19.338693 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449876a-81d8-4fc5-8790-d6a5a503cc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:19.339318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449876a-81d8-4fc5-8790-d6a5a503cc81 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:19.339592 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449876a-81d8-4fc5-8790-d6a5a503cc81 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:19.339854 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449876a-81d8-4fc5-8790-d6a5a503cc81 None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:19.340505 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449876a-81d8-4fc5-8790-d6a5a503cc81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:19.340797 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449876a-81d8-4fc5-8790-d6a5a503cc81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:19.342378 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449876a-81d8-4fc5-8790-d6a5a503cc81 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:19.364600 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 416/825] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:19.365875 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77115bed-1719-44d1-a1c8-7e6388b56692 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:19.452307 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:19.513929 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77115bed-1719-44d1-a1c8-7e6388b56692 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:19.555588 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11630c84-9783-4a11-b64c-2ce4153bf950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:19.556232 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11630c84-9783-4a11-b64c-2ce4153bf950 None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:19.556514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11630c84-9783-4a11-b64c-2ce4153bf950 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:19.556793 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11630c84-9783-4a11-b64c-2ce4153bf950 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:19.557473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11630c84-9783-4a11-b64c-2ce4153bf950 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:19.558954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11630c84-9783-4a11-b64c-2ce4153bf950 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:19.586918 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 410/826] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Aug 19 14:41:19 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 14:41:22.122174 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51542df2-cde3-4a05-9af4-435ec8c3057b None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:22.122770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51542df2-cde3-4a05-9af4-435ec8c3057b None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:22.122770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51542df2-cde3-4a05-9af4-435ec8c3057b None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:22.124347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 417/827] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:41:22.130795 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccbc4e-6456-4ad7-b532-f4e3e6fb4acc None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:22.131290 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccbc4e-6456-4ad7-b532-f4e3e6fb4acc None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:22.131464 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccbc4e-6456-4ad7-b532-f4e3e6fb4acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:22.153367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-51ccbc4e-6456-4ad7-b532-f4e3e6fb4acc None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:41:22.154814 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-51ccbc4e-6456-4ad7-b532-f4e3e6fb4acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:41:22.232657 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 411/828] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:41:22 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:41:22.567254 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51542df2-cde3-4a05-9af4-435ec8c3057b None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:22.697225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51542df2-cde3-4a05-9af4-435ec8c3057b None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:22.737064 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15965cd1-17e0-4974-97b2-ebb9048ddd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:22.737802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15965cd1-17e0-4974-97b2-ebb9048ddd44 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:22.738185 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15965cd1-17e0-4974-97b2-ebb9048ddd44 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:22.738456 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15965cd1-17e0-4974-97b2-ebb9048ddd44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:22.751799 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15965cd1-17e0-4974-97b2-ebb9048ddd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-15965cd1-17e0-4974-97b2-ebb9048ddd44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:41:22.757145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:22.758307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:22.759240 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 418/829] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:41:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:22.765112 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccbc4e-6456-4ad7-b532-f4e3e6fb4acc None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:22.808953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:22.897953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccbc4e-6456-4ad7-b532-f4e3e6fb4acc None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:22.946202 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfcc18-ce11-4298-9ada-827e6e91179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:22.946839 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfcc18-ce11-4298-9ada-827e6e91179f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:22.947119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfcc18-ce11-4298-9ada-827e6e91179f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:22.947438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfcc18-ce11-4298-9ada-827e6e91179f None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:22.948067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfcc18-ce11-4298-9ada-827e6e91179f None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:22.948371 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfcc18-ce11-4298-9ada-827e6e91179f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:22.949750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfcc18-ce11-4298-9ada-827e6e91179f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:22.961791 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 412/830] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:41:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:41:22.968405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15965cd1-17e0-4974-97b2-ebb9048ddd44 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:23.023962 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:23.090146 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15965cd1-17e0-4974-97b2-ebb9048ddd44 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:23.130943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eab557-8556-455a-bee2-fb2b63f364c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:23.132898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eab557-8556-455a-bee2-fb2b63f364c0 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:23.132898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eab557-8556-455a-bee2-fb2b63f364c0 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:23.132898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eab557-8556-455a-bee2-fb2b63f364c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:23.144873 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eab557-8556-455a-bee2-fb2b63f364c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:23.147657 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eab557-8556-455a-bee2-fb2b63f364c0 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-46eab557-8556-455a-bee2-fb2b63f364c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:23.163047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:23.169330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:23.170733 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:23.170733 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:23.170733 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:23.170733 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 419/831] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:23.171062 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfcc18-ce11-4298-9ada-827e6e91179f None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:23.290922 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:23.294695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfcc18-ce11-4298-9ada-827e6e91179f None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:23.338514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9c78-2fa4-41e6-8c39-9c300ec4cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:23.339197 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9c78-2fa4-41e6-8c39-9c300ec4cde5 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:23.339466 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9c78-2fa4-41e6-8c39-9c300ec4cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:23.339771 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9c78-2fa4-41e6-8c39-9c300ec4cde5 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:23.340397 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f9c78-2fa4-41e6-8c39-9c300ec4cde5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:23.340713 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f9c78-2fa4-41e6-8c39-9c300ec4cde5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:23.342250 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f9c78-2fa4-41e6-8c39-9c300ec4cde5 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:23.355374 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 413/832] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:41:23.361262 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eab557-8556-455a-bee2-fb2b63f364c0 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:23.475163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:23.478962 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eab557-8556-455a-bee2-fb2b63f364c0 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:23.517947 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceeba7a-9983-4947-b6a1-5b67e2008417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:23.518582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeba7a-9983-4947-b6a1-5b67e2008417 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:23.518855 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeba7a-9983-4947-b6a1-5b67e2008417 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:23.519122 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeba7a-9983-4947-b6a1-5b67e2008417 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:23.528362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceeba7a-9983-4947-b6a1-5b67e2008417 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:23.529823 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceeba7a-9983-4947-b6a1-5b67e2008417 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-3ceeba7a-9983-4947-b6a1-5b67e2008417 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:41:23.542506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:23.543639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:23.545301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 420/833] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:23.549871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9c78-2fa4-41e6-8c39-9c300ec4cde5 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:23.666229 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9c78-2fa4-41e6-8c39-9c300ec4cde5 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:23.709062 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ab538-4fa6-46d8-b362-48affb5cf255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:23.709834 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ab538-4fa6-46d8-b362-48affb5cf255 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:23.710178 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ab538-4fa6-46d8-b362-48affb5cf255 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:23.710676 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ab538-4fa6-46d8-b362-48affb5cf255 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:23.712014 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ab538-4fa6-46d8-b362-48affb5cf255 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:23.712269 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ab538-4fa6-46d8-b362-48affb5cf255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:23.713815 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ab538-4fa6-46d8-b362-48affb5cf255 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:23.734581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 414/834] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 14:41:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:23.740876 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceeba7a-9983-4947-b6a1-5b67e2008417 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:23.860648 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceeba7a-9983-4947-b6a1-5b67e2008417 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:23.910314 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088873b-8f3f-4a11-b59e-1413999fea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:23.910943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088873b-8f3f-4a11-b59e-1413999fea15 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:23.911202 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088873b-8f3f-4a11-b59e-1413999fea15 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:23.911512 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088873b-8f3f-4a11-b59e-1413999fea15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:23.949961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:24.006657 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088873b-8f3f-4a11-b59e-1413999fea15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:24.009067 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088873b-8f3f-4a11-b59e-1413999fea15 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:24.133369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 421/835] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:41:23 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 14:41:24.141181 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ab538-4fa6-46d8-b362-48affb5cf255 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:24.163238 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:24.267379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ab538-4fa6-46d8-b362-48affb5cf255 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:24.309826 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d511d-208c-461b-b82d-2b7bfb482987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:24.310536 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d511d-208c-461b-b82d-2b7bfb482987 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:24.310811 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d511d-208c-461b-b82d-2b7bfb482987 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:24.311216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d511d-208c-461b-b82d-2b7bfb482987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:24.323274 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d511d-208c-461b-b82d-2b7bfb482987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:24.324913 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d511d-208c-461b-b82d-2b7bfb482987 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-0f5d511d-208c-461b-b82d-2b7bfb482987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:24.344946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:24.346136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:24.347871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:24.347871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:24.347871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:24.347871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 415/836] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:24.353150 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088873b-8f3f-4a11-b59e-1413999fea15 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:24.418922 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:24.467312 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088873b-8f3f-4a11-b59e-1413999fea15 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:24.508261 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf418370-1412-477f-a4e2-e602519a322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:24.508954 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf418370-1412-477f-a4e2-e602519a322d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:24.509400 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf418370-1412-477f-a4e2-e602519a322d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:24.509888 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf418370-1412-477f-a4e2-e602519a322d None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:24.510659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf418370-1412-477f-a4e2-e602519a322d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:24.510961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf418370-1412-477f-a4e2-e602519a322d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:24.512365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf418370-1412-477f-a4e2-e602519a322d None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:24.529703 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 422/837] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:24.536516 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d511d-208c-461b-b82d-2b7bfb482987 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:24.624687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:24.675564 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d511d-208c-461b-b82d-2b7bfb482987 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:24.723720 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170c8f5-7752-4581-831e-a5ef3f8ee315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:24.725262 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170c8f5-7752-4581-831e-a5ef3f8ee315 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:24.725644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170c8f5-7752-4581-831e-a5ef3f8ee315 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:24.726113 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170c8f5-7752-4581-831e-a5ef3f8ee315 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:24.734903 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170c8f5-7752-4581-831e-a5ef3f8ee315 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:24.736494 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170c8f5-7752-4581-831e-a5ef3f8ee315 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-0170c8f5-7752-4581-831e-a5ef3f8ee315 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:41:24.752605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:24.754402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:24.756048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:41:24.756048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:41:24.756048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:41:24.756048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:41:24.756048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:41:24.756048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:41:24.756048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:24.756048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:24.756048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 416/838] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:41:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:24.761132 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf418370-1412-477f-a4e2-e602519a322d None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:24.921879 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf418370-1412-477f-a4e2-e602519a322d None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:24.943955 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:24.976034 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c043e6-463c-4a91-b6c9-12bec1d457a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:24.977542 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c043e6-463c-4a91-b6c9-12bec1d457a5 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:24.977973 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c043e6-463c-4a91-b6c9-12bec1d457a5 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:24.978448 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c043e6-463c-4a91-b6c9-12bec1d457a5 None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:24.979663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c043e6-463c-4a91-b6c9-12bec1d457a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:24.980181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c043e6-463c-4a91-b6c9-12bec1d457a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:24.982510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c043e6-463c-4a91-b6c9-12bec1d457a5 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:25.000625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 423/839] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:41:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:41:25.011670 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170c8f5-7752-4581-831e-a5ef3f8ee315 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:25.141803 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170c8f5-7752-4581-831e-a5ef3f8ee315 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:25.174814 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:25.183338 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c1d23-ede9-418b-93c6-7457367daf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:25.183974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c1d23-ede9-418b-93c6-7457367daf6b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:25.184267 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c1d23-ede9-418b-93c6-7457367daf6b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:25.184526 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c1d23-ede9-418b-93c6-7457367daf6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:25.185272 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c1d23-ede9-418b-93c6-7457367daf6b None admin] RBAC: Adding query filter params (role.id=a0c07ffc05d54106b2f356d6f76ae54b, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=6000b5f82dee4ff4abb8935efd8c39df) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:25.185583 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c1d23-ede9-418b-93c6-7457367daf6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:25.187080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c1d23-ede9-418b-93c6-7457367daf6b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:25.195221 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 417/840] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:41:25 2022] GET /identity/v3/role_assignments?user.id=6000b5f82dee4ff4abb8935efd8c39df&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=a0c07ffc05d54106b2f356d6f76ae54b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:41:27.648585 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f4c9b-9c81-4854-b3dd-76e004a2536e None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:27.649224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f4c9b-9c81-4854-b3dd-76e004a2536e None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:27.649224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f4c9b-9c81-4854-b3dd-76e004a2536e None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:27.650529 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 424/841] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:41:27.656605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54a42-e555-4e4d-9185-fc597f86ef72 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:27.657315 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54a42-e555-4e4d-9185-fc597f86ef72 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:27.657315 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54a42-e555-4e4d-9185-fc597f86ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:27.684637 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-9af54a42-e555-4e4d-9185-fc597f86ef72 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:41:27.686400 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-9af54a42-e555-4e4d-9185-fc597f86ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:41:27.774547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 418/842] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:41:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:41:28.165307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f4c9b-9c81-4854-b3dd-76e004a2536e None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:28.324141 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f4c9b-9c81-4854-b3dd-76e004a2536e None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:28.383964 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fabad-54f3-42ec-b127-c9ce86362748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:28.384412 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fabad-54f3-42ec-b127-c9ce86362748 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:28.384659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fabad-54f3-42ec-b127-c9ce86362748 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:28.384923 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fabad-54f3-42ec-b127-c9ce86362748 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:28.399397 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fabad-54f3-42ec-b127-c9ce86362748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-1d5fabad-54f3-42ec-b127-c9ce86362748 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:41:28.404831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:28.406009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:28.410821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 425/843] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:41:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:41:28.413235 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af54a42-e555-4e4d-9185-fc597f86ef72 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:28.552964 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af54a42-e555-4e4d-9185-fc597f86ef72 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:28.588550 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:28.602809 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b5cca-5754-4dde-afe5-41948cbd812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:28.603481 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b5cca-5754-4dde-afe5-41948cbd812a None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:28.603715 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b5cca-5754-4dde-afe5-41948cbd812a None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:28.603977 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b5cca-5754-4dde-afe5-41948cbd812a None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:28.604655 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b5cca-5754-4dde-afe5-41948cbd812a None admin] RBAC: Adding query filter params (name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:28.604959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b5cca-5754-4dde-afe5-41948cbd812a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:28.606371 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b5cca-5754-4dde-afe5-41948cbd812a None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:28.619966 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 419/844] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:41:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:28.626195 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fabad-54f3-42ec-b127-c9ce86362748 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:28.674394 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:28.738871 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fabad-54f3-42ec-b127-c9ce86362748 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:28.781596 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b8bf-763a-454d-868e-11b3aa235d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:28.782573 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b8bf-763a-454d-868e-11b3aa235d06 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:28.782994 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b8bf-763a-454d-868e-11b3aa235d06 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:28.783346 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b8bf-763a-454d-868e-11b3aa235d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:28.800868 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48b8bf-763a-454d-868e-11b3aa235d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:28.802569 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48b8bf-763a-454d-868e-11b3aa235d06 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-0b48b8bf-763a-454d-868e-11b3aa235d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:28.819333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:28.821213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:28.822375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:28.822375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:28.822375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:28.822375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 426/845] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:28.826910 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b5cca-5754-4dde-afe5-41948cbd812a None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:28.964926 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b5cca-5754-4dde-afe5-41948cbd812a None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:29.002833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342b22d-a365-4973-b9a2-8a8dcf3f6d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:29.003454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b22d-a365-4973-b9a2-8a8dcf3f6d6f None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:29.003737 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b22d-a365-4973-b9a2-8a8dcf3f6d6f None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:29.004048 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b22d-a365-4973-b9a2-8a8dcf3f6d6f None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:29.004705 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342b22d-a365-4973-b9a2-8a8dcf3f6d6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:29.005018 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342b22d-a365-4973-b9a2-8a8dcf3f6d6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:29.006479 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342b22d-a365-4973-b9a2-8a8dcf3f6d6f None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:29.019709 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 420/846] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:29.026213 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b8bf-763a-454d-868e-11b3aa235d06 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:29.132819 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:29.145808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b8bf-763a-454d-868e-11b3aa235d06 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:29.190843 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767574f-a178-45eb-83e8-36fc307a267c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:29.191683 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767574f-a178-45eb-83e8-36fc307a267c None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:29.191939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767574f-a178-45eb-83e8-36fc307a267c None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:29.192284 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767574f-a178-45eb-83e8-36fc307a267c None admin] PATH_INFO: `/v3/users/placement` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:29.201565 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767574f-a178-45eb-83e8-36fc307a267c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:29.203124 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767574f-a178-45eb-83e8-36fc307a267c None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-b767574f-a178-45eb-83e8-36fc307a267c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:41:29.215532 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:29.222311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:29.223468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 427/847] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:29.224063 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342b22d-a365-4973-b9a2-8a8dcf3f6d6f None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:29.283787 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:29.354638 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342b22d-a365-4973-b9a2-8a8dcf3f6d6f None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:29.402420 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5141303-7d92-4a60-97c5-71d9c75579bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:29.403423 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5141303-7d92-4a60-97c5-71d9c75579bb None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:29.403865 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5141303-7d92-4a60-97c5-71d9c75579bb None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:29.404323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5141303-7d92-4a60-97c5-71d9c75579bb None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:29.405642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5141303-7d92-4a60-97c5-71d9c75579bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:29.406210 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5141303-7d92-4a60-97c5-71d9c75579bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:29.408931 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5141303-7d92-4a60-97c5-71d9c75579bb None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:29.434346 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 421/848] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 14:41:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:29.443915 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767574f-a178-45eb-83e8-36fc307a267c None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:29.571229 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767574f-a178-45eb-83e8-36fc307a267c None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:29.617686 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df068-2dd0-4f33-9edf-f54d84ac3713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:29.618756 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df068-2dd0-4f33-9edf-f54d84ac3713 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:29.619198 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df068-2dd0-4f33-9edf-f54d84ac3713 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:29.619677 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df068-2dd0-4f33-9edf-f54d84ac3713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:29.634548 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8df068-2dd0-4f33-9edf-f54d84ac3713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:29.637206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8df068-2dd0-4f33-9edf-f54d84ac3713 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-2a8df068-2dd0-4f33-9edf-f54d84ac3713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:29.662694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:29.672081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:29.674132 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:29.674132 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:29.674132 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:29.674132 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 428/849] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:41:29.675248 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5141303-7d92-4a60-97c5-71d9c75579bb None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:29.810100 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5141303-7d92-4a60-97c5-71d9c75579bb None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:29.813490 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:29.857901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7958df7-48db-4409-9f09-c29f1ecfc2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:29.858859 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7958df7-48db-4409-9f09-c29f1ecfc2a5 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:29.858859 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7958df7-48db-4409-9f09-c29f1ecfc2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:29.859085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7958df7-48db-4409-9f09-c29f1ecfc2a5 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:29.859672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7958df7-48db-4409-9f09-c29f1ecfc2a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:29.859970 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7958df7-48db-4409-9f09-c29f1ecfc2a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:29.861354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7958df7-48db-4409-9f09-c29f1ecfc2a5 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:29.876691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 422/850] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:29.884241 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df068-2dd0-4f33-9edf-f54d84ac3713 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:29.888431 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:30.013322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df068-2dd0-4f33-9edf-f54d84ac3713 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:30.066404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57577ce-a629-4fa1-9d09-1836821934c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:30.067244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57577ce-a629-4fa1-9d09-1836821934c1 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:30.067627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57577ce-a629-4fa1-9d09-1836821934c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:30.067994 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57577ce-a629-4fa1-9d09-1836821934c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:30.077018 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57577ce-a629-4fa1-9d09-1836821934c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:30.078941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57577ce-a629-4fa1-9d09-1836821934c1 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-d57577ce-a629-4fa1-9d09-1836821934c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:41:30.093531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:30.094701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:30.095767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:41:30.095767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:41:30.095767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:41:30.095767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:41:30.095767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:41:30.095767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:41:30.095767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:30.095767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:30.095767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 429/851] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:30.101789 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7958df7-48db-4409-9f09-c29f1ecfc2a5 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:30.227186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7958df7-48db-4409-9f09-c29f1ecfc2a5 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:30.267447 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff5018-5d70-4212-aa30-261c37996348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:30.268064 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5018-5d70-4212-aa30-261c37996348 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:30.268335 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5018-5d70-4212-aa30-261c37996348 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:30.268601 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5018-5d70-4212-aa30-261c37996348 None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:30.269294 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff5018-5d70-4212-aa30-261c37996348 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:30.269592 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff5018-5d70-4212-aa30-261c37996348 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:30.271055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff5018-5d70-4212-aa30-261c37996348 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:30.284769 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 423/852] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:41:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:30.291123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57577ce-a629-4fa1-9d09-1836821934c1 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:30.372310 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:30.436055 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57577ce-a629-4fa1-9d09-1836821934c1 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:30.473369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c722-1af3-40e2-bdb0-6bd11bfed3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:30.474087 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c722-1af3-40e2-bdb0-6bd11bfed3fe None admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:30.474364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c722-1af3-40e2-bdb0-6bd11bfed3fe None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:30.474633 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c722-1af3-40e2-bdb0-6bd11bfed3fe None admin] PATH_INFO: `/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/6000b5f82dee4ff4abb8935efd8c39df/roles/a0c07ffc05d54106b2f356d6f76ae54b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:30.494839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012c722-1af3-40e2-bdb0-6bd11bfed3fe None admin] RBAC: Authorizing `identity:create_grant(project_id=715f57a8ea67473baf35f0bc91c0ffdb, user_id=6000b5f82dee4ff4abb8935efd8c39df, role_id=a0c07ffc05d54106b2f356d6f76ae54b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:30.496649 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012c722-1af3-40e2-bdb0-6bd11bfed3fe None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:30.514388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 430/853] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:41:30 2022] PUT /identity/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/6000b5f82dee4ff4abb8935efd8c39df/roles/a0c07ffc05d54106b2f356d6f76ae54b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 14:41:32.797438 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dacca-0a4e-4537-9ee3-94c50c0e6aa9 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:32.798057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dacca-0a4e-4537-9ee3-94c50c0e6aa9 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:32.798057 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dacca-0a4e-4537-9ee3-94c50c0e6aa9 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:32.799672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 424/854] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:41:32.808125 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e934cb1-dfe3-4122-98fa-a12f35d7a427 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:32.808928 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e934cb1-dfe3-4122-98fa-a12f35d7a427 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:32.808928 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e934cb1-dfe3-4122-98fa-a12f35d7a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:32.829195 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-7e934cb1-dfe3-4122-98fa-a12f35d7a427 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:41:32.830595 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-7e934cb1-dfe3-4122-98fa-a12f35d7a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:41:32.929111 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 431/855] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:41:32 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 14:41:33.259720 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dacca-0a4e-4537-9ee3-94c50c0e6aa9 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:33.292985 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:33.390552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dacca-0a4e-4537-9ee3-94c50c0e6aa9 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:33.430163 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdea3ce-581f-41c7-80d5-7e126c975b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:33.430977 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea3ce-581f-41c7-80d5-7e126c975b49 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:33.431317 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea3ce-581f-41c7-80d5-7e126c975b49 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:33.431689 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea3ce-581f-41c7-80d5-7e126c975b49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:33.445722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdea3ce-581f-41c7-80d5-7e126c975b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-9cdea3ce-581f-41c7-80d5-7e126c975b49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:41:33.450759 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:33.452036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:33.453141 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 425/856] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Aug 19 14:41:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:33.458184 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e934cb1-dfe3-4122-98fa-a12f35d7a427 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:33.511816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:33.585506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e934cb1-dfe3-4122-98fa-a12f35d7a427 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:33.626136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b7221-f77e-4938-b7dc-ce648cde48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:33.627162 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b7221-f77e-4938-b7dc-ce648cde48e0 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:33.627481 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b7221-f77e-4938-b7dc-ce648cde48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:33.627791 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b7221-f77e-4938-b7dc-ce648cde48e0 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:33.628557 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b7221-f77e-4938-b7dc-ce648cde48e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:33.628865 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b7221-f77e-4938-b7dc-ce648cde48e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:33.630394 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b7221-f77e-4938-b7dc-ce648cde48e0 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:33.640438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 432/857] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Aug 19 14:41:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:33.647044 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdea3ce-581f-41c7-80d5-7e126c975b49 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:33.752276 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:33.771351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdea3ce-581f-41c7-80d5-7e126c975b49 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:33.811060 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb8475-6b54-4394-94dc-9bc4097c9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:33.811869 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb8475-6b54-4394-94dc-9bc4097c9128 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:33.812215 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb8475-6b54-4394-94dc-9bc4097c9128 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:33.812496 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb8475-6b54-4394-94dc-9bc4097c9128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:33.825190 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb8475-6b54-4394-94dc-9bc4097c9128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:33.826734 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb8475-6b54-4394-94dc-9bc4097c9128 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-9ecb8475-6b54-4394-94dc-9bc4097c9128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:33.843901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:33.845410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:33.846374 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:33.846374 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:33.846374 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:33.846374 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 426/858] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:33.852089 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b7221-f77e-4938-b7dc-ce648cde48e0 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:33.984260 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b7221-f77e-4938-b7dc-ce648cde48e0 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:33.987688 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:34.029154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ae3ec-0c2c-4672-842f-5c5ba80d0c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:34.029612 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ae3ec-0c2c-4672-842f-5c5ba80d0c89 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:34.029612 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ae3ec-0c2c-4672-842f-5c5ba80d0c89 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:34.029797 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ae3ec-0c2c-4672-842f-5c5ba80d0c89 None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:34.030542 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ae3ec-0c2c-4672-842f-5c5ba80d0c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:34.030855 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ae3ec-0c2c-4672-842f-5c5ba80d0c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:34.032247 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ae3ec-0c2c-4672-842f-5c5ba80d0c89 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:34.045478 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 433/859] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:34.051705 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb8475-6b54-4394-94dc-9bc4097c9128 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:34.179846 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb8475-6b54-4394-94dc-9bc4097c9128 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:34.223060 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b970fa-f12d-4853-b536-207c4e6bc627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:34.223799 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b970fa-f12d-4853-b536-207c4e6bc627 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:34.224120 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b970fa-f12d-4853-b536-207c4e6bc627 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:34.224400 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b970fa-f12d-4853-b536-207c4e6bc627 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:34.228111 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:34.235280 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b970fa-f12d-4853-b536-207c4e6bc627 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:34.237197 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b970fa-f12d-4853-b536-207c4e6bc627 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-81b970fa-f12d-4853-b536-207c4e6bc627 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:41:34.251731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:34.252885 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:34.253833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 427/860] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:34.260246 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ae3ec-0c2c-4672-842f-5c5ba80d0c89 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:34.382616 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ae3ec-0c2c-4672-842f-5c5ba80d0c89 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:34.425733 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632238c7-37ea-4649-b634-2f65388a9c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:34.426380 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632238c7-37ea-4649-b634-2f65388a9c68 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:34.426646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632238c7-37ea-4649-b634-2f65388a9c68 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:34.426910 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632238c7-37ea-4649-b634-2f65388a9c68 None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:34.427652 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632238c7-37ea-4649-b634-2f65388a9c68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:34.427962 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632238c7-37ea-4649-b634-2f65388a9c68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:34.429435 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632238c7-37ea-4649-b634-2f65388a9c68 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:34.450661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 434/861] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 14:41:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:34.456956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b970fa-f12d-4853-b536-207c4e6bc627 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:34.593294 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b970fa-f12d-4853-b536-207c4e6bc627 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:34.636685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47554aa0-653c-43ec-ae4b-a330de1e085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:34.637219 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47554aa0-653c-43ec-ae4b-a330de1e085c None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:34.637487 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47554aa0-653c-43ec-ae4b-a330de1e085c None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:34.637750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47554aa0-653c-43ec-ae4b-a330de1e085c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:34.714974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:34.724702 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47554aa0-653c-43ec-ae4b-a330de1e085c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:34.726585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47554aa0-653c-43ec-ae4b-a330de1e085c None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:34.885273 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 428/862] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:41:34 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 14:41:34.887657 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632238c7-37ea-4649-b634-2f65388a9c68 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:34.930281 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:35.026156 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632238c7-37ea-4649-b634-2f65388a9c68 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:35.071011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a4a5-77b3-4c12-9b12-ecb3992658cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:35.071856 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a4a5-77b3-4c12-9b12-ecb3992658cf None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:35.072174 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a4a5-77b3-4c12-9b12-ecb3992658cf None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:35.072498 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a4a5-77b3-4c12-9b12-ecb3992658cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:35.086404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4a4a5-77b3-4c12-9b12-ecb3992658cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:35.087940 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4a4a5-77b3-4c12-9b12-ecb3992658cf None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-86b4a4a5-77b3-4c12-9b12-ecb3992658cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:35.105054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:35.106525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:35.107609 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:35.107609 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:35.107609 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:35.107609 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 435/863] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:35.112523 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47554aa0-653c-43ec-ae4b-a330de1e085c None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:35.226282 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:35.234543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47554aa0-653c-43ec-ae4b-a330de1e085c None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:35.277411 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af015041-0314-477f-a32a-3bdea691cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:35.278074 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af015041-0314-477f-a32a-3bdea691cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:35.278352 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af015041-0314-477f-a32a-3bdea691cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:35.278620 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af015041-0314-477f-a32a-3bdea691cdd2 None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:35.279295 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af015041-0314-477f-a32a-3bdea691cdd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:35.279591 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af015041-0314-477f-a32a-3bdea691cdd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:35.280978 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af015041-0314-477f-a32a-3bdea691cdd2 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:35.294028 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 429/864] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:35.300007 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a4a5-77b3-4c12-9b12-ecb3992658cf None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:35.397032 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:35.431442 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a4a5-77b3-4c12-9b12-ecb3992658cf None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:35.475315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebc71a-9f64-4cbb-b2f8-043ce69adebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:35.476068 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebc71a-9f64-4cbb-b2f8-043ce69adebd None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:35.476659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebc71a-9f64-4cbb-b2f8-043ce69adebd None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:35.477028 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebc71a-9f64-4cbb-b2f8-043ce69adebd None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:35.486853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebc71a-9f64-4cbb-b2f8-043ce69adebd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:35.488648 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebc71a-9f64-4cbb-b2f8-043ce69adebd None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-9eebc71a-9f64-4cbb-b2f8-043ce69adebd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:41:35.502527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:35.504315 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:35.506127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:41:35.506127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:41:35.506127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:41:35.506127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:41:35.506127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:41:35.506127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:41:35.506127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:35.506127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:35.506127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 436/865] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:41:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 14:41:35.512190 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af015041-0314-477f-a32a-3bdea691cdd2 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:35.636108 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af015041-0314-477f-a32a-3bdea691cdd2 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:35.676085 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf38fb9-58ce-45fb-bd68-0537cb3ff6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:35.676703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf38fb9-58ce-45fb-bd68-0537cb3ff6da None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:35.676976 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf38fb9-58ce-45fb-bd68-0537cb3ff6da None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:35.677251 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf38fb9-58ce-45fb-bd68-0537cb3ff6da None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:35.677984 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf38fb9-58ce-45fb-bd68-0537cb3ff6da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:35.678344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf38fb9-58ce-45fb-bd68-0537cb3ff6da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:35.679879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf38fb9-58ce-45fb-bd68-0537cb3ff6da None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:35.696183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 430/866] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:41:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:35.702409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebc71a-9f64-4cbb-b2f8-043ce69adebd None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:35.837464 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebc71a-9f64-4cbb-b2f8-043ce69adebd None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:35.877602 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99bee4-8473-4c99-8ea8-afea51038d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:35.878332 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99bee4-8473-4c99-8ea8-afea51038d71 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:35.878698 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99bee4-8473-4c99-8ea8-afea51038d71 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:35.879054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99bee4-8473-4c99-8ea8-afea51038d71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:35.879937 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99bee4-8473-4c99-8ea8-afea51038d71 None admin] RBAC: Adding query filter params (role.id=a0c07ffc05d54106b2f356d6f76ae54b, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=6000b5f82dee4ff4abb8935efd8c39df) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:35.880349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99bee4-8473-4c99-8ea8-afea51038d71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:35.882197 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99bee4-8473-4c99-8ea8-afea51038d71 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:35.884726 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:35.891153 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 437/867] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:41:35 2022] GET /identity/v3/role_assignments?user.id=6000b5f82dee4ff4abb8935efd8c39df&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=a0c07ffc05d54106b2f356d6f76ae54b => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:38.266749 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496ee30-e4bb-4f0f-8b9d-f794496fe16d None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:38.267338 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496ee30-e4bb-4f0f-8b9d-f794496fe16d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:38.267338 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496ee30-e4bb-4f0f-8b9d-f794496fe16d None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:38.268711 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 431/868] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:41:38.274887 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3cc5a-cf92-4ff2-9330-84fa6717056f None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:38.275381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3cc5a-cf92-4ff2-9330-84fa6717056f None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:38.275485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3cc5a-cf92-4ff2-9330-84fa6717056f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:38.295782 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-a5c3cc5a-cf92-4ff2-9330-84fa6717056f None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:41:38.296995 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-a5c3cc5a-cf92-4ff2-9330-84fa6717056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:41:38.382034 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 438/869] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:41:38 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:41:38.754399 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496ee30-e4bb-4f0f-8b9d-f794496fe16d None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:38.777765 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:38.882944 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496ee30-e4bb-4f0f-8b9d-f794496fe16d None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:38.925568 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac9819-fdba-428a-b490-d479ccb97e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:38.929059 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac9819-fdba-428a-b490-d479ccb97e61 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:38.929059 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac9819-fdba-428a-b490-d479ccb97e61 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:38.929059 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac9819-fdba-428a-b490-d479ccb97e61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:38.945216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac9819-fdba-428a-b490-d479ccb97e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-77ac9819-fdba-428a-b490-d479ccb97e61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:41:38.955408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:38.957385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:38.959495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 432/870] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:38.964949 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3cc5a-cf92-4ff2-9330-84fa6717056f None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:39.131085 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3cc5a-cf92-4ff2-9330-84fa6717056f None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:39.167483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:39.180510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474fdd-d400-458f-aecb-b75feacd9d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:39.181386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474fdd-d400-458f-aecb-b75feacd9d42 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:39.181877 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474fdd-d400-458f-aecb-b75feacd9d42 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:39.182277 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474fdd-d400-458f-aecb-b75feacd9d42 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:39.183068 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c474fdd-d400-458f-aecb-b75feacd9d42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:39.183453 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c474fdd-d400-458f-aecb-b75feacd9d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:39.184981 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c474fdd-d400-458f-aecb-b75feacd9d42 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:39.194687 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 439/871] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:39.201806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac9819-fdba-428a-b490-d479ccb97e61 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:39.308915 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:39.338309 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac9819-fdba-428a-b490-d479ccb97e61 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:39.380833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dc956-6625-4449-8fa8-d6f2068ada59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:39.381543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dc956-6625-4449-8fa8-d6f2068ada59 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:39.381721 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dc956-6625-4449-8fa8-d6f2068ada59 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:39.382187 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dc956-6625-4449-8fa8-d6f2068ada59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:39.395479 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dc956-6625-4449-8fa8-d6f2068ada59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:39.397045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dc956-6625-4449-8fa8-d6f2068ada59 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-996dc956-6625-4449-8fa8-d6f2068ada59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:39.415349 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:39.416454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:39.417771 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:39.417771 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:39.417771 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:39.417771 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 433/872] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:39.423397 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474fdd-d400-458f-aecb-b75feacd9d42 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:39.541675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474fdd-d400-458f-aecb-b75feacd9d42 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:39.580682 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bb81e-a4a3-4c65-8bf7-161d8f384c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:39.581539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bb81e-a4a3-4c65-8bf7-161d8f384c29 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:39.581960 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bb81e-a4a3-4c65-8bf7-161d8f384c29 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:39.582342 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bb81e-a4a3-4c65-8bf7-161d8f384c29 None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:39.583255 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bb81e-a4a3-4c65-8bf7-161d8f384c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:39.583639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bb81e-a4a3-4c65-8bf7-161d8f384c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:39.585540 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bb81e-a4a3-4c65-8bf7-161d8f384c29 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:39.601512 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 440/873] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:41:39.607279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dc956-6625-4449-8fa8-d6f2068ada59 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:39.734014 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dc956-6625-4449-8fa8-d6f2068ada59 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:39.769680 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:39.779439 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc08e7e-7f44-4128-85d6-13151b77c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:39.780232 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc08e7e-7f44-4128-85d6-13151b77c193 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:39.780509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc08e7e-7f44-4128-85d6-13151b77c193 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:39.780778 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc08e7e-7f44-4128-85d6-13151b77c193 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:39.793323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc08e7e-7f44-4128-85d6-13151b77c193 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:39.795144 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc08e7e-7f44-4128-85d6-13151b77c193 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-dcc08e7e-7f44-4128-85d6-13151b77c193 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:41:39.811921 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:39.813871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:39.816372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 434/874] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:39.820602 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bb81e-a4a3-4c65-8bf7-161d8f384c29 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:39.887304 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:39.974720 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bb81e-a4a3-4c65-8bf7-161d8f384c29 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:40.020082 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec86b9d-efd6-4933-9255-8d9455470791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:40.021200 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86b9d-efd6-4933-9255-8d9455470791 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:40.021643 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86b9d-efd6-4933-9255-8d9455470791 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:40.022314 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86b9d-efd6-4933-9255-8d9455470791 None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:40.023686 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec86b9d-efd6-4933-9255-8d9455470791 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:40.024269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec86b9d-efd6-4933-9255-8d9455470791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:40.026432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec86b9d-efd6-4933-9255-8d9455470791 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:40.060996 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 441/875] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 14:41:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:40.062959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc08e7e-7f44-4128-85d6-13151b77c193 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:40.266399 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc08e7e-7f44-4128-85d6-13151b77c193 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:40.306892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74aaf3-3588-4ccf-a56e-86f699efb9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:40.307404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74aaf3-3588-4ccf-a56e-86f699efb9d6 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:40.307657 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74aaf3-3588-4ccf-a56e-86f699efb9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:40.307932 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74aaf3-3588-4ccf-a56e-86f699efb9d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:40.369843 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:40.383106 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74aaf3-3588-4ccf-a56e-86f699efb9d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:40.384575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74aaf3-3588-4ccf-a56e-86f699efb9d6 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:40.507587 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 435/876] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:41:40 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 14:41:40.514907 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec86b9d-efd6-4933-9255-8d9455470791 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:40.641876 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec86b9d-efd6-4933-9255-8d9455470791 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:40.658951 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:40.689775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1543fd-ee57-4b45-a830-e2e14d233440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:40.691094 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1543fd-ee57-4b45-a830-e2e14d233440 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:40.691454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1543fd-ee57-4b45-a830-e2e14d233440 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:40.691827 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1543fd-ee57-4b45-a830-e2e14d233440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:40.703816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1543fd-ee57-4b45-a830-e2e14d233440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:40.705274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1543fd-ee57-4b45-a830-e2e14d233440 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-5e1543fd-ee57-4b45-a830-e2e14d233440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:40.723130 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:40.724308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:40.725413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:40.725413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:40.725413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:40.725413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 442/877] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:40.732060 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74aaf3-3588-4ccf-a56e-86f699efb9d6 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:40.854309 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:40.871170 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74aaf3-3588-4ccf-a56e-86f699efb9d6 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:40.924470 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55da9b-335b-4abc-943a-5ae3998a970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:40.925371 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55da9b-335b-4abc-943a-5ae3998a970b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:40.925874 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55da9b-335b-4abc-943a-5ae3998a970b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:40.926426 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55da9b-335b-4abc-943a-5ae3998a970b None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:40.927570 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55da9b-335b-4abc-943a-5ae3998a970b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:40.928227 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55da9b-335b-4abc-943a-5ae3998a970b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:40.930820 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55da9b-335b-4abc-943a-5ae3998a970b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:40.948227 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 436/878] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:40.955619 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1543fd-ee57-4b45-a830-e2e14d233440 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:41.100623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1543fd-ee57-4b45-a830-e2e14d233440 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:41.142727 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8837d-0b2d-499b-afed-2c07b8993ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:41.143364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8837d-0b2d-499b-afed-2c07b8993ffb None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:41.143638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8837d-0b2d-499b-afed-2c07b8993ffb None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:41.143907 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8837d-0b2d-499b-afed-2c07b8993ffb None admin] PATH_INFO: `/v3/projects/service` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:41.151235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8837d-0b2d-499b-afed-2c07b8993ffb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:41.152705 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8837d-0b2d-499b-afed-2c07b8993ffb None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-81a8837d-0b2d-499b-afed-2c07b8993ffb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:41:41.166040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:41.167154 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:41.168036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:41:41.168036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:41:41.168036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:41:41.168036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:41:41.168036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:41:41.168036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:41:41.168036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:41.168036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:41.168036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 443/879] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:41.177184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55da9b-335b-4abc-943a-5ae3998a970b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:41.306223 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55da9b-335b-4abc-943a-5ae3998a970b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:41.348571 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58b694-8284-43eb-b526-dfdfa4310ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:41.349775 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b694-8284-43eb-b526-dfdfa4310ae5 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:41.350353 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b694-8284-43eb-b526-dfdfa4310ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:41.350943 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b694-8284-43eb-b526-dfdfa4310ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:41.352023 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b694-8284-43eb-b526-dfdfa4310ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:41.352483 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b694-8284-43eb-b526-dfdfa4310ae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:41.354327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b694-8284-43eb-b526-dfdfa4310ae5 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:41.372146 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 437/880] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:41:41.378801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8837d-0b2d-499b-afed-2c07b8993ffb None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:41.407224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:41.505191 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8837d-0b2d-499b-afed-2c07b8993ffb None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:41.543867 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003fe12-53dc-4786-acfa-3ba657b37535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:41.544722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003fe12-53dc-4786-acfa-3ba657b37535 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:41.545182 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003fe12-53dc-4786-acfa-3ba657b37535 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:41.545560 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003fe12-53dc-4786-acfa-3ba657b37535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:41.546647 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003fe12-53dc-4786-acfa-3ba657b37535 None admin] RBAC: Adding query filter params (role.id=d444334199c640a7af820f46e283d49d, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=6000b5f82dee4ff4abb8935efd8c39df) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:41.547070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003fe12-53dc-4786-acfa-3ba657b37535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:41.549185 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003fe12-53dc-4786-acfa-3ba657b37535 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:41.557770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 444/881] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:41:41 2022] GET /identity/v3/role_assignments?user.id=6000b5f82dee4ff4abb8935efd8c39df&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=d444334199c640a7af820f46e283d49d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:43.764305 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253e41c-431c-4bb0-ade5-922ab79ded48 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:43.764853 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253e41c-431c-4bb0-ade5-922ab79ded48 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:43.764853 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253e41c-431c-4bb0-ade5-922ab79ded48 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:43.766271 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 438/882] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:41:43.771822 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a419f-5b15-4963-a4c7-48fde289e3c8 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:43.772293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a419f-5b15-4963-a4c7-48fde289e3c8 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:43.772384 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a419f-5b15-4963-a4c7-48fde289e3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:43.794811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-4a6a419f-5b15-4963-a4c7-48fde289e3c8 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:41:43.796031 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-4a6a419f-5b15-4963-a4c7-48fde289e3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:41:43.863988 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 445/883] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:41:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:41:44.198188 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253e41c-431c-4bb0-ade5-922ab79ded48 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:44.209643 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:44.323780 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253e41c-431c-4bb0-ade5-922ab79ded48 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:44.365556 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c630e-5878-4a63-8ee8-96222588f0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:44.366262 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c630e-5878-4a63-8ee8-96222588f0b6 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:44.366537 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c630e-5878-4a63-8ee8-96222588f0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:44.366799 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c630e-5878-4a63-8ee8-96222588f0b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:44.377938 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c630e-5878-4a63-8ee8-96222588f0b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-016c630e-5878-4a63-8ee8-96222588f0b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:41:44.382806 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:44.383959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:44.385119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 439/884] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:41:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:44.390330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a419f-5b15-4963-a4c7-48fde289e3c8 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:44.406073 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:44.492556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a419f-5b15-4963-a4c7-48fde289e3c8 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:44.528567 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5559868-6bb2-40aa-b64c-df667a83b790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:44.529181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5559868-6bb2-40aa-b64c-df667a83b790 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:44.529439 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5559868-6bb2-40aa-b64c-df667a83b790 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:44.529710 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5559868-6bb2-40aa-b64c-df667a83b790 None admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:44.530480 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5559868-6bb2-40aa-b64c-df667a83b790 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:44.530778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5559868-6bb2-40aa-b64c-df667a83b790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:44.532161 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5559868-6bb2-40aa-b64c-df667a83b790 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:44.540992 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 446/885] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:41:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:44.547020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c630e-5878-4a63-8ee8-96222588f0b6 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:44.617270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:44.652533 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c630e-5878-4a63-8ee8-96222588f0b6 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:44.688503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6963f52-4128-4f5e-96cd-16b346384fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:44.689156 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6963f52-4128-4f5e-96cd-16b346384fc9 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:44.689402 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6963f52-4128-4f5e-96cd-16b346384fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:44.689671 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6963f52-4128-4f5e-96cd-16b346384fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:44.700724 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6963f52-4128-4f5e-96cd-16b346384fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:44.702199 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6963f52-4128-4f5e-96cd-16b346384fc9 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-b6963f52-4128-4f5e-96cd-16b346384fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:44.716981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:44.718172 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:44.719230 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:44.719230 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:44.719230 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:44.719230 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 440/886] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:44.724208 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5559868-6bb2-40aa-b64c-df667a83b790 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:44.808292 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:44.834064 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5559868-6bb2-40aa-b64c-df667a83b790 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:44.870225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bfd7e-b36a-4d6c-8ad0-ed5332a9a9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:44.870990 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfd7e-b36a-4d6c-8ad0-ed5332a9a9d2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:44.871363 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfd7e-b36a-4d6c-8ad0-ed5332a9a9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:44.871676 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfd7e-b36a-4d6c-8ad0-ed5332a9a9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:44.872400 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bfd7e-b36a-4d6c-8ad0-ed5332a9a9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:44.872743 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bfd7e-b36a-4d6c-8ad0-ed5332a9a9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:44.874524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bfd7e-b36a-4d6c-8ad0-ed5332a9a9d2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:44.895397 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 447/887] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:44.896998 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6963f52-4128-4f5e-96cd-16b346384fc9 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:45.012803 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6963f52-4128-4f5e-96cd-16b346384fc9 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:45.034828 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:45.050832 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102c8bb-32e4-441a-adf7-6e43d465f5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:45.051471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102c8bb-32e4-441a-adf7-6e43d465f5fb None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:45.051745 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102c8bb-32e4-441a-adf7-6e43d465f5fb None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:45.052014 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102c8bb-32e4-441a-adf7-6e43d465f5fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:45.060953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102c8bb-32e4-441a-adf7-6e43d465f5fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:45.062385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102c8bb-32e4-441a-adf7-6e43d465f5fb None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-9102c8bb-32e4-441a-adf7-6e43d465f5fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:41:45.074979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:45.077161 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:45.079396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 441/888] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:45.084652 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bfd7e-b36a-4d6c-8ad0-ed5332a9a9d2 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:45.203460 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bfd7e-b36a-4d6c-8ad0-ed5332a9a9d2 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:45.239027 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365903b-4d38-4e7d-aa30-2e455be06413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:45.239637 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365903b-4d38-4e7d-aa30-2e455be06413 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:45.239910 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365903b-4d38-4e7d-aa30-2e455be06413 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:45.240176 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365903b-4d38-4e7d-aa30-2e455be06413 None admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:45.240909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365903b-4d38-4e7d-aa30-2e455be06413 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:45.241309 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365903b-4d38-4e7d-aa30-2e455be06413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:45.242813 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365903b-4d38-4e7d-aa30-2e455be06413 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:45.245676 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:45.261750 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 448/889] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 14:41:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:45.267641 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102c8bb-32e4-441a-adf7-6e43d465f5fb None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:45.389653 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102c8bb-32e4-441a-adf7-6e43d465f5fb None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:45.424986 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9db33b-6b24-4739-b55a-56a31b43afeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:45.425621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9db33b-6b24-4739-b55a-56a31b43afeb None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:45.425891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9db33b-6b24-4739-b55a-56a31b43afeb None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:45.426193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9db33b-6b24-4739-b55a-56a31b43afeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:45.437186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9db33b-6b24-4739-b55a-56a31b43afeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:45.438672 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9db33b-6b24-4739-b55a-56a31b43afeb None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-0c9db33b-6b24-4739-b55a-56a31b43afeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:45.453901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:45.455327 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:45.456545 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:45.456545 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:45.456545 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:45.456545 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 442/890] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:45.461701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365903b-4d38-4e7d-aa30-2e455be06413 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:45.566134 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365903b-4d38-4e7d-aa30-2e455be06413 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:45.599466 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46b90b-7188-488f-8c7d-060e6bc56f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:45.600066 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46b90b-7188-488f-8c7d-060e6bc56f7d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:45.600338 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46b90b-7188-488f-8c7d-060e6bc56f7d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:45.600643 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46b90b-7188-488f-8c7d-060e6bc56f7d None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:45.601333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46b90b-7188-488f-8c7d-060e6bc56f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:45.601629 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46b90b-7188-488f-8c7d-060e6bc56f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:45.603039 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46b90b-7188-488f-8c7d-060e6bc56f7d None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:45.614662 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 449/891] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:45.620705 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9db33b-6b24-4739-b55a-56a31b43afeb None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:45.655903 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:45.731742 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9db33b-6b24-4739-b55a-56a31b43afeb None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:45.767223 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e1257-ed34-4ca2-b4cc-4a9ee53fa741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:45.767833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e1257-ed34-4ca2-b4cc-4a9ee53fa741 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:45.768109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e1257-ed34-4ca2-b4cc-4a9ee53fa741 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:45.768401 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e1257-ed34-4ca2-b4cc-4a9ee53fa741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:45.775579 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e1257-ed34-4ca2-b4cc-4a9ee53fa741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:45.777032 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e1257-ed34-4ca2-b4cc-4a9ee53fa741 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-900e1257-ed34-4ca2-b4cc-4a9ee53fa741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:41:45.788646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:45.789761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:45.790736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:41:45.790736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:41:45.790736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:41:45.790736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:41:45.790736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:41:45.790736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:41:45.790736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:45.790736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:45.790736 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 443/892] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:45.796176 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46b90b-7188-488f-8c7d-060e6bc56f7d None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:45.854911 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:45.901949 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46b90b-7188-488f-8c7d-060e6bc56f7d None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:45.939928 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c019921-d831-4d8b-be17-d10252631256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:45.940437 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c019921-d831-4d8b-be17-d10252631256 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:45.941026 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c019921-d831-4d8b-be17-d10252631256 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:45.941294 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c019921-d831-4d8b-be17-d10252631256 None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:45.942075 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c019921-d831-4d8b-be17-d10252631256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:45.942402 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c019921-d831-4d8b-be17-d10252631256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:45.943852 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c019921-d831-4d8b-be17-d10252631256 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:45.956706 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 450/893] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:45.963631 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e1257-ed34-4ca2-b4cc-4a9ee53fa741 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:46.110935 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:46.122021 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e1257-ed34-4ca2-b4cc-4a9ee53fa741 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:46.160750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe61a-97b2-4357-99e5-9caee26f6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:46.161417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe61a-97b2-4357-99e5-9caee26f6721 None admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:46.161700 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe61a-97b2-4357-99e5-9caee26f6721 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:46.161970 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe61a-97b2-4357-99e5-9caee26f6721 None admin] PATH_INFO: `/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/6000b5f82dee4ff4abb8935efd8c39df/roles/d444334199c640a7af820f46e283d49d` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:46.164283 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbe61a-97b2-4357-99e5-9caee26f6721 None admin] RBAC: Authorizing `identity:create_grant(project_id=715f57a8ea67473baf35f0bc91c0ffdb, user_id=6000b5f82dee4ff4abb8935efd8c39df, role_id=d444334199c640a7af820f46e283d49d)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:46.165722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbe61a-97b2-4357-99e5-9caee26f6721 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:46.180908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 444/894] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Aug 19 14:41:45 2022] PUT /identity/v3/projects/715f57a8ea67473baf35f0bc91c0ffdb/users/6000b5f82dee4ff4abb8935efd8c39df/roles/d444334199c640a7af820f46e283d49d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:41:48.388709 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c0fe-b745-4568-ac0b-08d8df01549d None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:48.389390 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c0fe-b745-4568-ac0b-08d8df01549d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:48.389390 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c0fe-b745-4568-ac0b-08d8df01549d None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:48.390605 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 451/895] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:41:48.396183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20425103-689d-4c46-863d-1e97391276b1 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:48.396742 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20425103-689d-4c46-863d-1e97391276b1 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:48.396742 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20425103-689d-4c46-863d-1e97391276b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:48.416131 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-20425103-689d-4c46-863d-1e97391276b1 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:41:48.417329 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-20425103-689d-4c46-863d-1e97391276b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:41:48.491503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 445/896] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:41:48 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:41:48.811688 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7c0fe-b745-4568-ac0b-08d8df01549d None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:48.946837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7c0fe-b745-4568-ac0b-08d8df01549d None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:48.965099 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:48.986684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780b3e-58ca-4d19-b408-d4bbaf272d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:48.987323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780b3e-58ca-4d19-b408-d4bbaf272d7d None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:48.987595 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780b3e-58ca-4d19-b408-d4bbaf272d7d None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:48.987860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780b3e-58ca-4d19-b408-d4bbaf272d7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:48.999637 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21780b3e-58ca-4d19-b408-d4bbaf272d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-21780b3e-58ca-4d19-b408-d4bbaf272d7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 14:41:49.004653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:49.005747 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:49.006820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 452/897] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Aug 19 14:41:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:49.012053 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20425103-689d-4c46-863d-1e97391276b1 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:49.096485 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:49.118230 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20425103-689d-4c46-863d-1e97391276b1 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:49.154647 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07800b-ad13-45df-ac09-489fc3ddfd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:49.155258 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07800b-ad13-45df-ac09-489fc3ddfd00 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:49.155533 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07800b-ad13-45df-ac09-489fc3ddfd00 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:49.155803 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07800b-ad13-45df-ac09-489fc3ddfd00 None admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:49.156465 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07800b-ad13-45df-ac09-489fc3ddfd00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:49.156761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07800b-ad13-45df-ac09-489fc3ddfd00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:49.158170 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07800b-ad13-45df-ac09-489fc3ddfd00 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:49.167724 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 446/898] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Aug 19 14:41:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:49.173866 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780b3e-58ca-4d19-b408-d4bbaf272d7d None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:49.282782 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780b3e-58ca-4d19-b408-d4bbaf272d7d None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:49.320049 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4832d-7e33-490b-acb0-ec587e4311ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:49.320680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4832d-7e33-490b-acb0-ec587e4311ab None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:49.320958 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4832d-7e33-490b-acb0-ec587e4311ab None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:49.321228 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4832d-7e33-490b-acb0-ec587e4311ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:49.331477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4832d-7e33-490b-acb0-ec587e4311ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:49.332946 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4832d-7e33-490b-acb0-ec587e4311ab None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-84e4832d-7e33-490b-acb0-ec587e4311ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:49.349582 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:49.350838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:49.351917 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:49.351917 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:49.351917 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:49.351917 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 453/899] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:49.357609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07800b-ad13-45df-ac09-489fc3ddfd00 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:49.467335 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07800b-ad13-45df-ac09-489fc3ddfd00 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:49.503134 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61078fcd-ab62-4187-8ff5-692b6eac919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:49.503766 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61078fcd-ab62-4187-8ff5-692b6eac919b None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:49.504043 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61078fcd-ab62-4187-8ff5-692b6eac919b None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:49.504314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61078fcd-ab62-4187-8ff5-692b6eac919b None admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:49.504957 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61078fcd-ab62-4187-8ff5-692b6eac919b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:49.505257 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61078fcd-ab62-4187-8ff5-692b6eac919b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:49.506658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61078fcd-ab62-4187-8ff5-692b6eac919b None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:49.519565 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 447/900] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:49.525793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4832d-7e33-490b-acb0-ec587e4311ab None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:49.568899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:49.654108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4832d-7e33-490b-acb0-ec587e4311ab None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:49.689773 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c872d-619b-4c74-bfd6-e8d6015b85b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:49.690414 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c872d-619b-4c74-bfd6-e8d6015b85b8 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:49.690991 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c872d-619b-4c74-bfd6-e8d6015b85b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:49.691253 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c872d-619b-4c74-bfd6-e8d6015b85b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:49.699366 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c872d-619b-4c74-bfd6-e8d6015b85b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:49.700812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c872d-619b-4c74-bfd6-e8d6015b85b8 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-4b5c872d-619b-4c74-bfd6-e8d6015b85b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 14:41:49.712011 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:49.713801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:49.716029 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 454/901] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:49.720682 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61078fcd-ab62-4187-8ff5-692b6eac919b None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:49.725905 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:49.834610 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61078fcd-ab62-4187-8ff5-692b6eac919b None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:49.871382 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577492cc-893f-4c5d-ae71-42739d1b5c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:49.872008 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577492cc-893f-4c5d-ae71-42739d1b5c01 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:49.872270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577492cc-893f-4c5d-ae71-42739d1b5c01 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:49.872536 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577492cc-893f-4c5d-ae71-42739d1b5c01 None admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:49.873264 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577492cc-893f-4c5d-ae71-42739d1b5c01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:49.873561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577492cc-893f-4c5d-ae71-42739d1b5c01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:49.875118 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577492cc-893f-4c5d-ae71-42739d1b5c01 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:49.894784 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 448/902] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Aug 19 14:41:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:49.900902 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c872d-619b-4c74-bfd6-e8d6015b85b8 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:49.993431 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:50.010354 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c872d-619b-4c74-bfd6-e8d6015b85b8 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:50.045885 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecb040-e00e-4462-98cf-52ff2f25257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:50.046519 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecb040-e00e-4462-98cf-52ff2f25257e None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:50.046793 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecb040-e00e-4462-98cf-52ff2f25257e None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:50.047070 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecb040-e00e-4462-98cf-52ff2f25257e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:50.117875 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecb040-e00e-4462-98cf-52ff2f25257e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:50.119354 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecb040-e00e-4462-98cf-52ff2f25257e None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:50.211910 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:50.228504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 455/903] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Aug 19 14:41:49 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 14:41:50.234616 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577492cc-893f-4c5d-ae71-42739d1b5c01 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:50.303133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:50.349622 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577492cc-893f-4c5d-ae71-42739d1b5c01 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:50.394764 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ad9a1-d27d-4b01-a6dd-8a7641b52f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:50.395406 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ad9a1-d27d-4b01-a6dd-8a7641b52f54 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:50.395678 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ad9a1-d27d-4b01-a6dd-8a7641b52f54 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:50.395946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ad9a1-d27d-4b01-a6dd-8a7641b52f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:50.407343 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ad9a1-d27d-4b01-a6dd-8a7641b52f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:50.408817 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ad9a1-d27d-4b01-a6dd-8a7641b52f54 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-395ad9a1-d27d-4b01-a6dd-8a7641b52f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 14:41:50.430409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:50.432244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 14:41:50.434140 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 14:41:50.434140 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 14:41:50.434140 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:50.434140 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 449/904] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:50.438967 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecb040-e00e-4462-98cf-52ff2f25257e None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:50.546367 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecb040-e00e-4462-98cf-52ff2f25257e None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:50.582149 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254bbf2-4636-4edb-bdda-77386c952ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:50.582708 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254bbf2-4636-4edb-bdda-77386c952ffb None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:50.583039 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254bbf2-4636-4edb-bdda-77386c952ffb None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:50.583353 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254bbf2-4636-4edb-bdda-77386c952ffb None admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:50.584004 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254bbf2-4636-4edb-bdda-77386c952ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:50.584300 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254bbf2-4636-4edb-bdda-77386c952ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:50.586395 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254bbf2-4636-4edb-bdda-77386c952ffb None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:50.598555 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 456/905] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Aug 19 14:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:50.605421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ad9a1-d27d-4b01-a6dd-8a7641b52f54 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:50.719217 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ad9a1-d27d-4b01-a6dd-8a7641b52f54 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:50.733942 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:50.759144 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e42ee5-d934-42d5-a31e-f54fc0405772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:50.759799 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42ee5-d934-42d5-a31e-f54fc0405772 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:50.760073 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42ee5-d934-42d5-a31e-f54fc0405772 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:50.760339 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42ee5-d934-42d5-a31e-f54fc0405772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:50.769068 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e42ee5-d934-42d5-a31e-f54fc0405772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:50.771487 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e42ee5-d934-42d5-a31e-f54fc0405772 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application [None req-a2e42ee5-d934-42d5-a31e-f54fc0405772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 14:41:50.793632 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:50.794838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:50.795906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 14:41:50.795906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 14:41:50.795906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 14:41:50.795906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 14:41:50.795906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 14:41:50.795906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 14:41:50.795906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 14:41:50.795906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: ERROR keystone.server.flask.application Aug 19 14:41:50.795906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 450/906] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Aug 19 14:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:50.801897 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254bbf2-4636-4edb-bdda-77386c952ffb None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:50.852010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:50.916882 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254bbf2-4636-4edb-bdda-77386c952ffb None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:50.959230 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94914728-1fcd-4469-820f-d53e7a4dcc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:50.959892 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94914728-1fcd-4469-820f-d53e7a4dcc4c None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:50.960368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94914728-1fcd-4469-820f-d53e7a4dcc4c None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:50.960482 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94914728-1fcd-4469-820f-d53e7a4dcc4c None admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:50.961392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94914728-1fcd-4469-820f-d53e7a4dcc4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:50.961734 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94914728-1fcd-4469-820f-d53e7a4dcc4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:50.963219 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94914728-1fcd-4469-820f-d53e7a4dcc4c None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:50.976253 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 457/907] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Aug 19 14:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:50.983136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e42ee5-d934-42d5-a31e-f54fc0405772 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:51.112444 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e42ee5-d934-42d5-a31e-f54fc0405772 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:51.149426 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9412e-458d-4e11-abd6-f22d76dde4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:51.150056 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9412e-458d-4e11-abd6-f22d76dde4bd None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:51.150330 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9412e-458d-4e11-abd6-f22d76dde4bd None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:51.150593 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9412e-458d-4e11-abd6-f22d76dde4bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:51.151306 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9412e-458d-4e11-abd6-f22d76dde4bd None admin] RBAC: Adding query filter params (role.id=d444334199c640a7af820f46e283d49d, scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb, user.id=6000b5f82dee4ff4abb8935efd8c39df) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:51.151605 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9412e-458d-4e11-abd6-f22d76dde4bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:51.153014 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9412e-458d-4e11-abd6-f22d76dde4bd None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:51.158995 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 451/908] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Aug 19 14:41:50 2022] GET /identity/v3/role_assignments?user.id=6000b5f82dee4ff4abb8935efd8c39df&scope.project.id=715f57a8ea67473baf35f0bc91c0ffdb&role.id=d444334199c640a7af820f46e283d49d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:53.370538 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033de51f-c546-4b7f-82f6-c918148eee44 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:53.371088 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033de51f-c546-4b7f-82f6-c918148eee44 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:53.371088 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033de51f-c546-4b7f-82f6-c918148eee44 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:53.372381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 458/909] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:41:53.378077 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f91d8c-b967-4bf9-9e35-b74c064b0b9b None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:53.378574 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f91d8c-b967-4bf9-9e35-b74c064b0b9b None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:53.378684 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f91d8c-b967-4bf9-9e35-b74c064b0b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:53.398031 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-79f91d8c-b967-4bf9-9e35-b74c064b0b9b None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:41:53.399380 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-79f91d8c-b967-4bf9-9e35-b74c064b0b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:41:53.430798 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:53.469070 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 452/910] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:41:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:41:53.788917 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033de51f-c546-4b7f-82f6-c918148eee44 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:53.901196 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033de51f-c546-4b7f-82f6-c918148eee44 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:53.910314 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:53.944108 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4e4ef-560a-4d36-af5f-84a20c1f09bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:53.944843 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4e4ef-560a-4d36-af5f-84a20c1f09bf None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:53.945165 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4e4ef-560a-4d36-af5f-84a20c1f09bf None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:53.945443 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4e4ef-560a-4d36-af5f-84a20c1f09bf None admin] PATH_INFO: `/v3/services/placement` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:53.946157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4e4ef-560a-4d36-af5f-84a20c1f09bf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:53.947777 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4e4ef-560a-4d36-af5f-84a20c1f09bf None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-88f4e4ef-560a-4d36-af5f-84a20c1f09bf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:53.958061 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:53.959539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:53.960445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 459/911] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Aug 19 14:41:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:53.966190 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f91d8c-b967-4bf9-9e35-b74c064b0b9b None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:54.078193 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f91d8c-b967-4bf9-9e35-b74c064b0b9b None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:54.117603 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd0428-4f72-42c3-8fc4-1ec41e2e2597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:54.118283 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0428-4f72-42c3-8fc4-1ec41e2e2597 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:54.118552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0428-4f72-42c3-8fc4-1ec41e2e2597 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:54.118814 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0428-4f72-42c3-8fc4-1ec41e2e2597 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:54.119448 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd0428-4f72-42c3-8fc4-1ec41e2e2597 None admin] RBAC: Adding query filter params (name=placement) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:54.119739 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd0428-4f72-42c3-8fc4-1ec41e2e2597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:54.121251 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd0428-4f72-42c3-8fc4-1ec41e2e2597 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:54.133416 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 453/912] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Aug 19 14:41:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:54.139541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4e4ef-560a-4d36-af5f-84a20c1f09bf None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:54.256267 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4e4ef-560a-4d36-af5f-84a20c1f09bf None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:54.295024 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084adbb0-98e5-4fbd-8d80-590b0e865f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:54.295643 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084adbb0-98e5-4fbd-8d80-590b0e865f02 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:54.295911 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084adbb0-98e5-4fbd-8d80-590b0e865f02 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:54.296177 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084adbb0-98e5-4fbd-8d80-590b0e865f02 None admin] PATH_INFO: `/v3/services` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:54.296827 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084adbb0-98e5-4fbd-8d80-590b0e865f02 None admin] RBAC: Adding query filter params (type=placement) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:41:54.297128 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084adbb0-98e5-4fbd-8d80-590b0e865f02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:54.298575 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084adbb0-98e5-4fbd-8d80-590b0e865f02 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:54.303416 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 460/913] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Aug 19 14:41:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:41:56.521837 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98313cc-cdc5-4b02-9bb9-7b65167fe751 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:56.522673 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98313cc-cdc5-4b02-9bb9-7b65167fe751 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:56.522673 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98313cc-cdc5-4b02-9bb9-7b65167fe751 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:56.523845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 454/914] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:41:56.529627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b03d9b-4f9f-41d8-9d70-54fafa1c24e9 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:56.530100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b03d9b-4f9f-41d8-9d70-54fafa1c24e9 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:56.530191 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b03d9b-4f9f-41d8-9d70-54fafa1c24e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:56.549858 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-26b03d9b-4f9f-41d8-9d70-54fafa1c24e9 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:41:56.551123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-26b03d9b-4f9f-41d8-9d70-54fafa1c24e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:41:56.587304 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:56.641548 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 461/915] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:41:56 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:41:56.972113 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98313cc-cdc5-4b02-9bb9-7b65167fe751 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:57.018154 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:41:57.098122 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98313cc-cdc5-4b02-9bb9-7b65167fe751 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:57.133575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58644e4a-74cd-485d-8045-e0c017b373eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:57.134218 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58644e4a-74cd-485d-8045-e0c017b373eb None admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:57.134487 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58644e4a-74cd-485d-8045-e0c017b373eb None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:57.134748 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58644e4a-74cd-485d-8045-e0c017b373eb None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:57.135378 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58644e4a-74cd-485d-8045-e0c017b373eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:57.136727 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58644e4a-74cd-485d-8045-e0c017b373eb None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:57.153012 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 455/916] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Aug 19 14:41:56 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:41:59.362603 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff917c3-009d-4718-ad79-4d1eefa6316c None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:59.363386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff917c3-009d-4718-ad79-4d1eefa6316c None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:59.363386 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff917c3-009d-4718-ad79-4d1eefa6316c None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:59.364553 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 462/917] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:41:59.370228 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc523bed-a274-48a5-acad-88babd5b1a44 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:59.370956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc523bed-a274-48a5-acad-88babd5b1a44 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:59.370956 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc523bed-a274-48a5-acad-88babd5b1a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:59.389822 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-fc523bed-a274-48a5-acad-88babd5b1a44 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:41:59.391062 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-fc523bed-a274-48a5-acad-88babd5b1a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:41:59.473485 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 456/918] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:41:59 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:41:59.797411 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff917c3-009d-4718-ad79-4d1eefa6316c None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:41:59.911884 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff917c3-009d-4718-ad79-4d1eefa6316c None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:41:59.958991 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75d34a-d70c-4ccf-a9a4-3abe280d1281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:41:59.959626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75d34a-d70c-4ccf-a9a4-3abe280d1281 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:41:59.959966 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75d34a-d70c-4ccf-a9a4-3abe280d1281 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:41:59.960232 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75d34a-d70c-4ccf-a9a4-3abe280d1281 None admin] PATH_INFO: `/v3/services/placement` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:41:59.961067 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75d34a-d70c-4ccf-a9a4-3abe280d1281 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:41:59.962492 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75d34a-d70c-4ccf-a9a4-3abe280d1281 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-6b75d34a-d70c-4ccf-a9a4-3abe280d1281 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:41:59.972459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:41:59.973638 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:41:59.974528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 463/919] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Aug 19 14:41:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:41:59.984559 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc523bed-a274-48a5-acad-88babd5b1a44 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:42:00.012879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:42:00.108476 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc523bed-a274-48a5-acad-88babd5b1a44 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:42:00.144312 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f43e8-f62d-438c-b71f-182b966459c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:42:00.144917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f43e8-f62d-438c-b71f-182b966459c7 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:42:00.145183 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f43e8-f62d-438c-b71f-182b966459c7 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:42:00.145444 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f43e8-f62d-438c-b71f-182b966459c7 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:42:00.146108 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f43e8-f62d-438c-b71f-182b966459c7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:42:00.146399 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f43e8-f62d-438c-b71f-182b966459c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:42:00.147926 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f43e8-f62d-438c-b71f-182b966459c7 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:42:00.153822 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 457/920] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Aug 19 14:41:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 14:42:00.159919 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75d34a-d70c-4ccf-a9a4-3abe280d1281 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:42:00.191254 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:42:00.272889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75d34a-d70c-4ccf-a9a4-3abe280d1281 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:42:00.311467 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769fd08-ab90-4a34-b134-51d26680e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:42:00.312078 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769fd08-ab90-4a34-b134-51d26680e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:42:00.312348 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769fd08-ab90-4a34-b134-51d26680e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:42:00.312618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769fd08-ab90-4a34-b134-51d26680e3b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:42:00.313346 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769fd08-ab90-4a34-b134-51d26680e3b2 None admin] RBAC: Adding query filter params (interface=public, service_id=60e945bb8670496cbceac5f6dcaa0561, region_id=RegionOne) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:42:00.313659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769fd08-ab90-4a34-b134-51d26680e3b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:42:00.315112 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769fd08-ab90-4a34-b134-51d26680e3b2 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:42:00.321881 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 464/921] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Aug 19 14:42:00 2022] GET /identity/v3/endpoints?service_id=60e945bb8670496cbceac5f6dcaa0561&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:42:00.328111 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f43e8-f62d-438c-b71f-182b966459c7 None admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:42:00.426642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:42:00.445241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f43e8-f62d-438c-b71f-182b966459c7 None admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:42:00.482464 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96a9b8-e2df-4c7b-aa1f-156c4a00dcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:42:00.483078 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96a9b8-e2df-4c7b-aa1f-156c4a00dcc2 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:42:00.483348 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96a9b8-e2df-4c7b-aa1f-156c4a00dcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:42:00.483617 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96a9b8-e2df-4c7b-aa1f-156c4a00dcc2 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:42:00.484220 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96a9b8-e2df-4c7b-aa1f-156c4a00dcc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:42:00.485585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96a9b8-e2df-4c7b-aa1f-156c4a00dcc2 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:42:00.492914 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 458/922] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Aug 19 14:42:00 2022] GET /identity/v3/services => generated 1962 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:42:02.678765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd43c08-0011-4b1a-8363-74bceb4b3fa9 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:42:02.679291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd43c08-0011-4b1a-8363-74bceb4b3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:42:02.679291 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd43c08-0011-4b1a-8363-74bceb4b3fa9 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:42:02.680529 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 465/923] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:42:02.686169 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073af92c-af46-4663-9ea9-3a809aa398e5 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:42:02.686731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073af92c-af46-4663-9ea9-3a809aa398e5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:42:02.686731 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073af92c-af46-4663-9ea9-3a809aa398e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:42:02.705432 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-073af92c-af46-4663-9ea9-3a809aa398e5 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:42:02.706667 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-073af92c-af46-4663-9ea9-3a809aa398e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:42:02.780360 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 459/924] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:42:02 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 14:42:03.104131 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd43c08-0011-4b1a-8363-74bceb4b3fa9 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:42:03.232482 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:42:03.244188 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd43c08-0011-4b1a-8363-74bceb4b3fa9 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:42:03.294383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507f33a-5472-496f-8c35-4a13008fdc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:42:03.295042 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f33a-5472-496f-8c35-4a13008fdc33 None admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:42:03.295290 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f33a-5472-496f-8c35-4a13008fdc33 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:42:03.295561 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f33a-5472-496f-8c35-4a13008fdc33 None admin] PATH_INFO: `/v3/services/placement` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:42:03.296157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507f33a-5472-496f-8c35-4a13008fdc33 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:42:03.297579 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507f33a-5472-496f-8c35-4a13008fdc33 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application [None req-5507f33a-5472-496f-8c35-4a13008fdc33 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 14:42:03.307812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 14:42:03.309405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application with Lock( Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self._enter() Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application return self.creator() Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application created_value = creator( Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: ERROR keystone.server.flask.application Aug 19 14:42:03.310510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 466/925] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Aug 19 14:42:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 14:42:03.315553 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073af92c-af46-4663-9ea9-3a809aa398e5 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:42:03.426609 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:42:03.459823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073af92c-af46-4663-9ea9-3a809aa398e5 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:42:03.503387 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f46c1-a48b-47d6-bb8f-34ff01c766c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:42:03.504010 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f46c1-a48b-47d6-bb8f-34ff01c766c2 None admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:42:03.504288 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f46c1-a48b-47d6-bb8f-34ff01c766c2 None admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:42:03.504561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f46c1-a48b-47d6-bb8f-34ff01c766c2 None admin] PATH_INFO: `/v3/services` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:42:03.505209 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f46c1-a48b-47d6-bb8f-34ff01c766c2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:42:03.505509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f46c1-a48b-47d6-bb8f-34ff01c766c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:42:03.507352 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f46c1-a48b-47d6-bb8f-34ff01c766c2 None admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:42:03.512998 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 460/926] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Aug 19 14:42:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:42:03.519134 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507f33a-5472-496f-8c35-4a13008fdc33 None admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:42:03.634817 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507f33a-5472-496f-8c35-4a13008fdc33 None admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:42:03.669652 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add24242-0575-45ec-b8a5-bb4e11224572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:42:03.670295 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add24242-0575-45ec-b8a5-bb4e11224572 None admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:42:03.670566 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add24242-0575-45ec-b8a5-bb4e11224572 None admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:42:03.670833 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add24242-0575-45ec-b8a5-bb4e11224572 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:42:03.671552 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add24242-0575-45ec-b8a5-bb4e11224572 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:42:03.672988 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add24242-0575-45ec-b8a5-bb4e11224572 None admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:42:03.696372 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 467/927] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:42:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:42:13.509950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=30 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:42:13.691174 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:43:07.032795 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea850f5-a18b-4fd3-b907-3bde2a76b91b None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:07.033404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea850f5-a18b-4fd3-b907-3bde2a76b91b None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:07.033404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea850f5-a18b-4fd3-b907-3bde2a76b91b None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:07.034970 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 461/928] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:07.043375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72b2fa-903a-443b-b0bd-71b04f3ffe88 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:07.043978 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72b2fa-903a-443b-b0bd-71b04f3ffe88 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:07.044256 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72b2fa-903a-443b-b0bd-71b04f3ffe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:07.071093 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-db72b2fa-903a-443b-b0bd-71b04f3ffe88 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:07.072090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-db72b2fa-903a-443b-b0bd-71b04f3ffe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:07.152245 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 468/929] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:07.507911 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e959-201a-4c66-a06a-195e5bc318a1 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:07.508581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e959-201a-4c66-a06a-195e5bc318a1 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:07.508581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e959-201a-4c66-a06a-195e5bc318a1 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:07.510150 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 462/930] 10.222.0.60 () {54 vars in 965 bytes} [Fri Aug 19 14:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:07.518084 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a08a3-5937-40ab-9993-05de55cc923d None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:07.518379 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a08a3-5937-40ab-9993-05de55cc923d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:07.518646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a08a3-5937-40ab-9993-05de55cc923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:07.589449 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-0d3a08a3-5937-40ab-9993-05de55cc923d None None] MFA Rules not processed for user `ff8273f4715e4f8ca50106a9abf7781b`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:07.590945 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-0d3a08a3-5937-40ab-9993-05de55cc923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:07.678194 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 469/931] 10.222.0.60 () {58 vars in 1062 bytes} [Fri Aug 19 14:43:07 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:07.687473 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2e959-201a-4c66-a06a-195e5bc318a1 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:07.699973 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2e959-201a-4c66-a06a-195e5bc318a1 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:07.703912 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8ae5f-fd69-4f98-a4ed-6d55b73e4618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:07.707562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8ae5f-fd69-4f98-a4ed-6d55b73e4618 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:07.707562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8ae5f-fd69-4f98-a4ed-6d55b73e4618 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:07.707562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8ae5f-fd69-4f98-a4ed-6d55b73e4618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:07.722554 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8ae5f-fd69-4f98-a4ed-6d55b73e4618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:07.724429 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8ae5f-fd69-4f98-a4ed-6d55b73e4618 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:07.738840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 463/932] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 14:43:10.408668 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a75f4-d777-4d9d-b5e7-37765c381016 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:10.409192 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a75f4-d777-4d9d-b5e7-37765c381016 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:10.409192 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a75f4-d777-4d9d-b5e7-37765c381016 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:10.410537 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 470/933] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:10.417450 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559333f1-f1db-415d-93f2-606607a6dd66 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:10.418035 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559333f1-f1db-415d-93f2-606607a6dd66 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:10.418035 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559333f1-f1db-415d-93f2-606607a6dd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:10.439618 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-559333f1-f1db-415d-93f2-606607a6dd66 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:10.440954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-559333f1-f1db-415d-93f2-606607a6dd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:10.450262 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 464/934] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:10.813378 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343cf3-6321-419b-adea-5b10fd4d8727 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:10.813570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343cf3-6321-419b-adea-5b10fd4d8727 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:10.813819 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343cf3-6321-419b-adea-5b10fd4d8727 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:10.815407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 471/935] 10.222.0.60 () {54 vars in 965 bytes} [Fri Aug 19 14:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:10.822197 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f7c2d-6171-4fbb-a1ef-8c268bde7348 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:10.822497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f7c2d-6171-4fbb-a1ef-8c268bde7348 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:10.822741 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f7c2d-6171-4fbb-a1ef-8c268bde7348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:10.845659 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-136f7c2d-6171-4fbb-a1ef-8c268bde7348 None None] MFA Rules not processed for user `ff8273f4715e4f8ca50106a9abf7781b`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:10.846925 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-136f7c2d-6171-4fbb-a1ef-8c268bde7348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:10.853711 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 465/936] 10.222.0.60 () {58 vars in 1062 bytes} [Fri Aug 19 14:43:10 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:10.862506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62343cf3-6321-419b-adea-5b10fd4d8727 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:10.874208 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62343cf3-6321-419b-adea-5b10fd4d8727 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:10.878166 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e2ef0-b078-4566-9535-a856b8e8a340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:10.878857 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2ef0-b078-4566-9535-a856b8e8a340 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:10.879152 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2ef0-b078-4566-9535-a856b8e8a340 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:10.879392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2ef0-b078-4566-9535-a856b8e8a340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:10.890357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e2ef0-b078-4566-9535-a856b8e8a340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:10.891848 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e2ef0-b078-4566-9535-a856b8e8a340 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:10.907333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 472/937] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:13.685797 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18148484-4fbc-4591-aa0b-a2cf45df28b4 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:13.686379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18148484-4fbc-4591-aa0b-a2cf45df28b4 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:13.686379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18148484-4fbc-4591-aa0b-a2cf45df28b4 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:13.687896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 466/938] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:13.693971 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697a9af-9055-436c-912a-49b1edd305ab None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:13.694483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697a9af-9055-436c-912a-49b1edd305ab None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:13.694483 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697a9af-9055-436c-912a-49b1edd305ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:13.736372 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-3697a9af-9055-436c-912a-49b1edd305ab None None] MFA Rules not processed for user `e8676f826bd04492bdb84c50b42a20be`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:13.737618 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-3697a9af-9055-436c-912a-49b1edd305ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:13.782200 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:43:13.813151 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 473/939] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:13 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:14.156795 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18148484-4fbc-4591-aa0b-a2cf45df28b4 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:14.170215 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18148484-4fbc-4591-aa0b-a2cf45df28b4 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:14.174203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfaf44-014f-487a-9a40-4e1133feeea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:14.174853 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfaf44-014f-487a-9a40-4e1133feeea9 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:14.175123 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfaf44-014f-487a-9a40-4e1133feeea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:14.175382 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfaf44-014f-487a-9a40-4e1133feeea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:14.186503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfaf44-014f-487a-9a40-4e1133feeea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:14.187953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfaf44-014f-487a-9a40-4e1133feeea9 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:14.199687 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 467/940] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:14 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:17.048212 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e92833-d349-48aa-ae2d-b044a003bfaa None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:17.048999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e92833-d349-48aa-ae2d-b044a003bfaa None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:17.048999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e92833-d349-48aa-ae2d-b044a003bfaa None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:17.050159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 474/941] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:17.056073 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287314-257e-4ac5-8cbf-315056420a52 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:17.056888 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287314-257e-4ac5-8cbf-315056420a52 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:17.056888 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287314-257e-4ac5-8cbf-315056420a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:17.077590 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-cf287314-257e-4ac5-8cbf-315056420a52 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:17.078852 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-cf287314-257e-4ac5-8cbf-315056420a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:17.164055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 468/942] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:17 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:17.503369 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e92833-d349-48aa-ae2d-b044a003bfaa None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:17.517716 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e92833-d349-48aa-ae2d-b044a003bfaa None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:17.522069 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b49c2-d04c-4083-a3de-3025964b3a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:17.522740 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b49c2-d04c-4083-a3de-3025964b3a50 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:17.523014 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b49c2-d04c-4083-a3de-3025964b3a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:17.523282 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b49c2-d04c-4083-a3de-3025964b3a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:17.533400 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b49c2-d04c-4083-a3de-3025964b3a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:17.534916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b49c2-d04c-4083-a3de-3025964b3a50 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:17.544802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 475/943] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:17 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:20.538419 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f2f7-0f68-433d-87ca-a2ddfef8d9fb None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:20.538989 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f2f7-0f68-433d-87ca-a2ddfef8d9fb None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:20.538989 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f2f7-0f68-433d-87ca-a2ddfef8d9fb None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:20.540429 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 469/944] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:20.546208 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3206a7-baad-48a6-92ed-724b2f3a5551 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:20.546681 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3206a7-baad-48a6-92ed-724b2f3a5551 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:20.546781 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3206a7-baad-48a6-92ed-724b2f3a5551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:20.569283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-4b3206a7-baad-48a6-92ed-724b2f3a5551 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:20.570622 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-4b3206a7-baad-48a6-92ed-724b2f3a5551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:20.578929 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 476/945] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:20.914670 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270f2f7-0f68-433d-87ca-a2ddfef8d9fb None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:20.926526 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270f2f7-0f68-433d-87ca-a2ddfef8d9fb None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:20.930038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5ff4f-23ef-4101-95ec-c87d29918778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:20.930688 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5ff4f-23ef-4101-95ec-c87d29918778 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:20.931067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5ff4f-23ef-4101-95ec-c87d29918778 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:20.931300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5ff4f-23ef-4101-95ec-c87d29918778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:20.941279 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5ff4f-23ef-4101-95ec-c87d29918778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:20.943176 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5ff4f-23ef-4101-95ec-c87d29918778 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:20.954653 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 470/946] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:23.284578 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966a833-3327-493e-8284-22ac1e78d701 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:23.284578 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966a833-3327-493e-8284-22ac1e78d701 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:23.284578 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966a833-3327-493e-8284-22ac1e78d701 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:23.285325 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 477/947] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:23.291078 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048776a-f034-4f65-a00c-3660cc3af52c None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:23.291573 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048776a-f034-4f65-a00c-3660cc3af52c None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:23.291686 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048776a-f034-4f65-a00c-3660cc3af52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:23.317280 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-6048776a-f034-4f65-a00c-3660cc3af52c None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:23.318576 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-6048776a-f034-4f65-a00c-3660cc3af52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:23.328118 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 471/948] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:23.666274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966a833-3327-493e-8284-22ac1e78d701 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:23.678916 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966a833-3327-493e-8284-22ac1e78d701 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:23.684187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbc9a7-9a3b-4dab-af34-3b37ef2b7e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:23.684817 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbc9a7-9a3b-4dab-af34-3b37ef2b7e07 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:23.685082 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbc9a7-9a3b-4dab-af34-3b37ef2b7e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:23.685347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbc9a7-9a3b-4dab-af34-3b37ef2b7e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:23.696069 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbc9a7-9a3b-4dab-af34-3b37ef2b7e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:23.697539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbc9a7-9a3b-4dab-af34-3b37ef2b7e07 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:23.708374 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 478/949] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:26.011275 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536a6a-05b4-4b14-af04-9dd08bcfc064 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:26.011833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536a6a-05b4-4b14-af04-9dd08bcfc064 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:26.011833 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536a6a-05b4-4b14-af04-9dd08bcfc064 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:26.013167 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 472/950] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:26.018965 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565cb8c-f517-4468-bb21-df049601dc58 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:26.019493 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565cb8c-f517-4468-bb21-df049601dc58 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:26.019493 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565cb8c-f517-4468-bb21-df049601dc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:26.048741 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-6565cb8c-f517-4468-bb21-df049601dc58 None None] MFA Rules not processed for user `e8676f826bd04492bdb84c50b42a20be`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:26.050052 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-6565cb8c-f517-4468-bb21-df049601dc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:26.058527 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 479/951] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:26 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:26.401829 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41536a6a-05b4-4b14-af04-9dd08bcfc064 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:26.415181 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41536a6a-05b4-4b14-af04-9dd08bcfc064 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:26.419301 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48f638-5dca-4f63-befc-badbb4bb8a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:26.419993 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48f638-5dca-4f63-befc-badbb4bb8a1b service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:26.420217 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48f638-5dca-4f63-befc-badbb4bb8a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:26.420452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48f638-5dca-4f63-befc-badbb4bb8a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:26.431055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48f638-5dca-4f63-befc-badbb4bb8a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:26.432532 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48f638-5dca-4f63-befc-badbb4bb8a1b service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:26.443163 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 473/952] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:26 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:29.292303 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952c717-b60c-4092-a5f8-9e6c081ae580 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:29.292792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952c717-b60c-4092-a5f8-9e6c081ae580 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:29.292792 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952c717-b60c-4092-a5f8-9e6c081ae580 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:29.294321 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 480/953] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:29.299823 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6ca2f-d0c0-4435-b377-fde16978e9f6 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:29.300282 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6ca2f-d0c0-4435-b377-fde16978e9f6 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:29.300390 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6ca2f-d0c0-4435-b377-fde16978e9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:29.320573 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-fac6ca2f-d0c0-4435-b377-fde16978e9f6 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:29.321755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-fac6ca2f-d0c0-4435-b377-fde16978e9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:29.330551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 474/954] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:29.674571 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952c717-b60c-4092-a5f8-9e6c081ae580 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:29.686942 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952c717-b60c-4092-a5f8-9e6c081ae580 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:29.690847 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2662f1e-1121-496f-a27d-e0106ac1c871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:29.691378 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662f1e-1121-496f-a27d-e0106ac1c871 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:29.691956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662f1e-1121-496f-a27d-e0106ac1c871 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:29.692217 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662f1e-1121-496f-a27d-e0106ac1c871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:29.703292 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2662f1e-1121-496f-a27d-e0106ac1c871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:29.705961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2662f1e-1121-496f-a27d-e0106ac1c871 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:29.722283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 481/955] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:32.001813 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd122fb-e46b-4e96-80a3-f32ce8465176 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:32.002396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd122fb-e46b-4e96-80a3-f32ce8465176 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:32.002396 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd122fb-e46b-4e96-80a3-f32ce8465176 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:32.003716 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 475/956] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:32.009389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d6a86-b39e-4f01-9b68-cdc746db8fcb None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:32.010319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d6a86-b39e-4f01-9b68-cdc746db8fcb None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:32.010779 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d6a86-b39e-4f01-9b68-cdc746db8fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:32.030776 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-628d6a86-b39e-4f01-9b68-cdc746db8fcb None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:32.031980 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-628d6a86-b39e-4f01-9b68-cdc746db8fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:32.040370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 482/957] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:32.385974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd122fb-e46b-4e96-80a3-f32ce8465176 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:32.401189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd122fb-e46b-4e96-80a3-f32ce8465176 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:32.406991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5051a-3d16-492b-8c49-97264f993b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:32.407973 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5051a-3d16-492b-8c49-97264f993b49 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:32.408409 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5051a-3d16-492b-8c49-97264f993b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:32.408691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5051a-3d16-492b-8c49-97264f993b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:32.419054 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5051a-3d16-492b-8c49-97264f993b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:32.420545 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5051a-3d16-492b-8c49-97264f993b49 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:32.431126 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 476/958] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:34.999284 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676683-793a-4663-af43-5dcf43801a53 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:34.999863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676683-793a-4663-af43-5dcf43801a53 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:34.999863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676683-793a-4663-af43-5dcf43801a53 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:35.001150 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 483/959] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:35.009320 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e322-96ee-40b0-91ab-1a353c65dd04 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:35.009882 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e322-96ee-40b0-91ab-1a353c65dd04 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:35.010165 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e322-96ee-40b0-91ab-1a353c65dd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:35.021460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=74 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:43:35.036362 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-17d6e322-96ee-40b0-91ab-1a353c65dd04 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:35.037601 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-17d6e322-96ee-40b0-91ab-1a353c65dd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:35.055283 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 477/960] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:35 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:35.398197 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676683-793a-4663-af43-5dcf43801a53 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:35.410739 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676683-793a-4663-af43-5dcf43801a53 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:35.415019 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8182cf-af0f-4094-93a6-6124584938b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:35.415628 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8182cf-af0f-4094-93a6-6124584938b7 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:35.415898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8182cf-af0f-4094-93a6-6124584938b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:35.416159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8182cf-af0f-4094-93a6-6124584938b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:35.425941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8182cf-af0f-4094-93a6-6124584938b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:35.427433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8182cf-af0f-4094-93a6-6124584938b7 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:35.437344 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 484/961] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:35 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:39.834680 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5138f82-e90e-4c1b-ab7e-12e99e28fbf1 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:39.835214 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5138f82-e90e-4c1b-ab7e-12e99e28fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:39.835214 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5138f82-e90e-4c1b-ab7e-12e99e28fbf1 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:39.836611 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 478/962] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:39.842323 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628c8b3-f041-430c-bb63-c167eb6d2e51 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:39.842841 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628c8b3-f041-430c-bb63-c167eb6d2e51 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:39.842841 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628c8b3-f041-430c-bb63-c167eb6d2e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:39.864864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-d628c8b3-f041-430c-bb63-c167eb6d2e51 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:39.866176 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-d628c8b3-f041-430c-bb63-c167eb6d2e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:39.875217 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 485/963] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:40.212970 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5138f82-e90e-4c1b-ab7e-12e99e28fbf1 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:40.224671 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5138f82-e90e-4c1b-ab7e-12e99e28fbf1 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:40.228930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df8dba-8180-4cf0-a3f7-f2ddac7a9a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:40.229557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df8dba-8180-4cf0-a3f7-f2ddac7a9a42 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:40.229824 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df8dba-8180-4cf0-a3f7-f2ddac7a9a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:40.230120 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df8dba-8180-4cf0-a3f7-f2ddac7a9a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:40.240965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df8dba-8180-4cf0-a3f7-f2ddac7a9a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:40.242540 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df8dba-8180-4cf0-a3f7-f2ddac7a9a42 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:40.253247 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 479/964] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:43.169906 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c771a-68c0-4891-a727-2ba6c5f7fb39 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:43.170518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c771a-68c0-4891-a727-2ba6c5f7fb39 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:43.170518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c771a-68c0-4891-a727-2ba6c5f7fb39 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:43.171825 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 486/965] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:43.177789 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21491695-a8c6-44bb-833b-414891b91ad9 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:43.178302 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21491695-a8c6-44bb-833b-414891b91ad9 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:43.178557 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21491695-a8c6-44bb-833b-414891b91ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:43.199699 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-21491695-a8c6-44bb-833b-414891b91ad9 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:43.200964 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-21491695-a8c6-44bb-833b-414891b91ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:43.209560 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 480/966] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:43 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:43.544818 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c771a-68c0-4891-a727-2ba6c5f7fb39 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:43.557382 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c771a-68c0-4891-a727-2ba6c5f7fb39 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:43.561056 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716d43b-a034-4f59-994f-b9c5fbf6c725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:43.561704 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716d43b-a034-4f59-994f-b9c5fbf6c725 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:43.562006 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716d43b-a034-4f59-994f-b9c5fbf6c725 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:43.562274 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716d43b-a034-4f59-994f-b9c5fbf6c725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:43.572436 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716d43b-a034-4f59-994f-b9c5fbf6c725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:43.573949 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716d43b-a034-4f59-994f-b9c5fbf6c725 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:43.584241 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 487/967] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:43 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:48.396357 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aac99-000b-4ab9-9d35-da59e5d6344b None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:48.396920 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aac99-000b-4ab9-9d35-da59e5d6344b None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:48.396920 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aac99-000b-4ab9-9d35-da59e5d6344b None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:48.398184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 481/968] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:48.404623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3b70c-3b46-4246-9a8b-0b9f15f5b527 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:48.405172 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3b70c-3b46-4246-9a8b-0b9f15f5b527 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:48.405439 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3b70c-3b46-4246-9a8b-0b9f15f5b527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:48.414829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=54 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:43:48.428663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-efe3b70c-3b46-4246-9a8b-0b9f15f5b527 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:48.430058 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-efe3b70c-3b46-4246-9a8b-0b9f15f5b527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:48.438980 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 488/969] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:43:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:48.779621 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aac99-000b-4ab9-9d35-da59e5d6344b None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:43:48.799157 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aac99-000b-4ab9-9d35-da59e5d6344b None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:43:48.802690 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff670b-9c92-44b3-bf14-b2cdef726ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:43:48.803241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff670b-9c92-44b3-bf14-b2cdef726ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:48.803510 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff670b-9c92-44b3-bf14-b2cdef726ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:48.803774 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff670b-9c92-44b3-bf14-b2cdef726ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:48.819385 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff670b-9c92-44b3-bf14-b2cdef726ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:43:48.821158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff670b-9c92-44b3-bf14-b2cdef726ce1 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:43:48.832050 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 482/970] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:43:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:43:54.544537 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5887366-ab45-4ab1-8b52-7744da2851c9 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:54.545477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5887366-ab45-4ab1-8b52-7744da2851c9 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:54.547717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5887366-ab45-4ab1-8b52-7744da2851c9 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:54.551448 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 489/971] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 14:43:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:54.559237 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d7d5-cc7b-4a08-a34a-ede4bd3e1f43 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:54.559753 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d7d5-cc7b-4a08-a34a-ede4bd3e1f43 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:54.560455 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d7d5-cc7b-4a08-a34a-ede4bd3e1f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:54.665367 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-1a94d7d5-cc7b-4a08-a34a-ede4bd3e1f43 None None] MFA Rules not processed for user `6000b5f82dee4ff4abb8935efd8c39df`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:54.667963 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-1a94d7d5-cc7b-4a08-a34a-ede4bd3e1f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:54.871954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 483/972] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 14:43:54 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:43:58.423808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=2 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:43:59.776228 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ba9c6-5a2c-4f51-a240-92cd581b6b6a None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:59.777808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ba9c6-5a2c-4f51-a240-92cd581b6b6a None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:59.778515 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ba9c6-5a2c-4f51-a240-92cd581b6b6a None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:59.781290 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 490/973] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 14:43:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:43:59.786690 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096167-c18f-4e46-a1aa-bb0de229150e None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:43:59.787452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096167-c18f-4e46-a1aa-bb0de229150e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:43:59.787452 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096167-c18f-4e46-a1aa-bb0de229150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:43:59.808293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-37096167-c18f-4e46-a1aa-bb0de229150e None None] MFA Rules not processed for user `6000b5f82dee4ff4abb8935efd8c39df`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:43:59.809475 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-37096167-c18f-4e46-a1aa-bb0de229150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:43:59.819975 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 484/974] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 14:43:59 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 14:44:01.578623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c81914-ce0f-474d-8dc1-a689268d7508 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:01.579175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c81914-ce0f-474d-8dc1-a689268d7508 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:01.579175 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c81914-ce0f-474d-8dc1-a689268d7508 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:01.580626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 491/975] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:01.587471 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffbc5f-7091-477a-9c02-3a33b15031ae None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:01.588244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffbc5f-7091-477a-9c02-3a33b15031ae None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:01.588244 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffbc5f-7091-477a-9c02-3a33b15031ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:01.612654 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-18ffbc5f-7091-477a-9c02-3a33b15031ae None None] MFA Rules not processed for user `6000b5f82dee4ff4abb8935efd8c39df`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:01.613889 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-18ffbc5f-7091-477a-9c02-3a33b15031ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:01.624359 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 485/976] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 14:44:01 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:05.457140 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa4097-04fb-4b76-8004-c4d40ab690a5 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:05.457672 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa4097-04fb-4b76-8004-c4d40ab690a5 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:05.457672 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa4097-04fb-4b76-8004-c4d40ab690a5 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:05.460216 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 492/977] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:05.466382 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51607e-d130-4ba9-a8b3-6af06bd03f96 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:05.466892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51607e-d130-4ba9-a8b3-6af06bd03f96 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:05.467136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51607e-d130-4ba9-a8b3-6af06bd03f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:05.476802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=63 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:44:05.494890 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-cd51607e-d130-4ba9-a8b3-6af06bd03f96 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:05.497423 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-cd51607e-d130-4ba9-a8b3-6af06bd03f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:05.510388 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 486/978] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:05.884359 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b1df9-5cc4-465f-95e7-fb2cd423eb6c None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:05.884957 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b1df9-5cc4-465f-95e7-fb2cd423eb6c None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:05.885535 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b1df9-5cc4-465f-95e7-fb2cd423eb6c None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:05.887413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 493/979] 10.222.0.60 () {54 vars in 962 bytes} [Fri Aug 19 14:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:05.895259 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff234e0-a99d-4b19-8ae0-998b1fd36c1d None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:05.895831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff234e0-a99d-4b19-8ae0-998b1fd36c1d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:05.896282 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff234e0-a99d-4b19-8ae0-998b1fd36c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:05.945086 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-2ff234e0-a99d-4b19-8ae0-998b1fd36c1d None None] MFA Rules not processed for user `c1a9ed9280d249f9a76d037ff8407082`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:05.946678 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-2ff234e0-a99d-4b19-8ae0-998b1fd36c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:06.039133 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 487/980] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Aug 19 14:44:05 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 14:44:06.046889 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b1df9-5cc4-465f-95e7-fb2cd423eb6c None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:06.061508 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b1df9-5cc4-465f-95e7-fb2cd423eb6c None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:06.066451 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4296ed6-f5cb-49e9-9b74-c296518fcb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:06.067491 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4296ed6-f5cb-49e9-9b74-c296518fcb56 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:06.067863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4296ed6-f5cb-49e9-9b74-c296518fcb56 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:06.068220 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4296ed6-f5cb-49e9-9b74-c296518fcb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:06.077305 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4296ed6-f5cb-49e9-9b74-c296518fcb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:06.079060 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4296ed6-f5cb-49e9-9b74-c296518fcb56 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:06.089181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 494/981] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:08.548089 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650506e-8a15-4d01-ad45-503a43844bac None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:08.548654 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650506e-8a15-4d01-ad45-503a43844bac None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:08.548654 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650506e-8a15-4d01-ad45-503a43844bac None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:08.550138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 488/982] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:08.555786 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8c8aa-b0e7-49e2-8439-b6bc5b6dc18a None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:08.556250 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8c8aa-b0e7-49e2-8439-b6bc5b6dc18a None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:08.556328 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8c8aa-b0e7-49e2-8439-b6bc5b6dc18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:08.576169 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-53e8c8aa-b0e7-49e2-8439-b6bc5b6dc18a None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:08.577375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-53e8c8aa-b0e7-49e2-8439-b6bc5b6dc18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:08.593856 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 495/983] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:08.931359 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650506e-8a15-4d01-ad45-503a43844bac None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:08.946060 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650506e-8a15-4d01-ad45-503a43844bac None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:08.951321 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886bded-82ed-4d5b-820d-10a85202b886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:08.952044 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886bded-82ed-4d5b-820d-10a85202b886 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:08.952321 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886bded-82ed-4d5b-820d-10a85202b886 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:08.952726 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886bded-82ed-4d5b-820d-10a85202b886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:08.961853 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886bded-82ed-4d5b-820d-10a85202b886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:08.963509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886bded-82ed-4d5b-820d-10a85202b886 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:08.974198 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 489/984] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:11.680463 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6a67-e4d7-46ce-957a-f712620dc260 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:11.681021 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6a67-e4d7-46ce-957a-f712620dc260 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:11.681114 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6a67-e4d7-46ce-957a-f712620dc260 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:11.682519 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 496/985] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:11.688405 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc87ac-1c41-4574-bb91-92df5199d1dd None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:11.688870 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc87ac-1c41-4574-bb91-92df5199d1dd None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:11.688958 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc87ac-1c41-4574-bb91-92df5199d1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:11.712377 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-3cbc87ac-1c41-4574-bb91-92df5199d1dd None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:11.713768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-3cbc87ac-1c41-4574-bb91-92df5199d1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:11.724443 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 490/986] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:12.098379 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befbae4-4d81-4d6e-88db-7ab602b87f6d None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:12.098917 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befbae4-4d81-4d6e-88db-7ab602b87f6d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:12.099192 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befbae4-4d81-4d6e-88db-7ab602b87f6d None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:12.100574 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 497/987] 10.222.0.60 () {54 vars in 962 bytes} [Fri Aug 19 14:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:12.107489 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98afe9-2641-416d-80a0-76e9e8bcc72a None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:12.107989 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98afe9-2641-416d-80a0-76e9e8bcc72a None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:12.108408 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98afe9-2641-416d-80a0-76e9e8bcc72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:12.130616 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-3b98afe9-2641-416d-80a0-76e9e8bcc72a None None] MFA Rules not processed for user `c1a9ed9280d249f9a76d037ff8407082`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:12.131830 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-3b98afe9-2641-416d-80a0-76e9e8bcc72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:12.142933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 491/988] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Aug 19 14:44:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:12.151075 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befbae4-4d81-4d6e-88db-7ab602b87f6d None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:12.164906 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befbae4-4d81-4d6e-88db-7ab602b87f6d None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:12.170080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b90d-d7d1-4405-b458-c272e64d7178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:12.170713 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b90d-d7d1-4405-b458-c272e64d7178 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:12.170990 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b90d-d7d1-4405-b458-c272e64d7178 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:12.171255 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b90d-d7d1-4405-b458-c272e64d7178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:12.180462 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4b90d-d7d1-4405-b458-c272e64d7178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:12.182235 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4b90d-d7d1-4405-b458-c272e64d7178 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:12.194773 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 498/989] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:14.585768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0db23-234a-4c9a-b003-a80bfefe2f0b None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:14.586779 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0db23-234a-4c9a-b003-a80bfefe2f0b None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:14.586779 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0db23-234a-4c9a-b003-a80bfefe2f0b None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:14.593455 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc7b3-ca4f-4439-93f3-4bf46667cd55 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:14.594422 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc7b3-ca4f-4439-93f3-4bf46667cd55 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:14.594913 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc7b3-ca4f-4439-93f3-4bf46667cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:14.598102 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 492/990] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:14.627313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-5dbcc7b3-ca4f-4439-93f3-4bf46667cd55 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:14.628910 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-5dbcc7b3-ca4f-4439-93f3-4bf46667cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:14.646683 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 499/991] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:15.002233 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0db23-234a-4c9a-b003-a80bfefe2f0b None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:15.017693 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0db23-234a-4c9a-b003-a80bfefe2f0b None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:15.023122 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6444dd-9cb8-429d-9f37-d1844946faec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:15.023991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6444dd-9cb8-429d-9f37-d1844946faec service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:15.024464 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6444dd-9cb8-429d-9f37-d1844946faec service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:15.024930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6444dd-9cb8-429d-9f37-d1844946faec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:15.035417 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6444dd-9cb8-429d-9f37-d1844946faec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:15.037575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6444dd-9cb8-429d-9f37-d1844946faec service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:15.061230 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 493/992] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:15.908572 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07b23-6d2c-4061-a649-ea0896bd60fb None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:15.909036 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07b23-6d2c-4061-a649-ea0896bd60fb None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:15.909184 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07b23-6d2c-4061-a649-ea0896bd60fb None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:15.914543 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 500/993] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:15.918195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e284-4835-4b80-8f67-7ad3b4e01203 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:15.919264 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e284-4835-4b80-8f67-7ad3b4e01203 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:15.920080 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e284-4835-4b80-8f67-7ad3b4e01203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:15.981794 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-7670e284-4835-4b80-8f67-7ad3b4e01203 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:15.985757 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-7670e284-4835-4b80-8f67-7ad3b4e01203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:16.010446 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 494/994] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:16.639603 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713792d-59d1-416f-a4f9-aa1094020a98 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:16.639603 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713792d-59d1-416f-a4f9-aa1094020a98 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:16.639603 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713792d-59d1-416f-a4f9-aa1094020a98 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:16.639603 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 501/995] 10.222.0.60 () {54 vars in 964 bytes} [Fri Aug 19 14:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:16.644703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e1c60-7224-4a61-9a2e-d05ec7734636 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:16.644964 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e1c60-7224-4a61-9a2e-d05ec7734636 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:16.645290 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e1c60-7224-4a61-9a2e-d05ec7734636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:16.686104 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-083e1c60-7224-4a61-9a2e-d05ec7734636 None None] MFA Rules not processed for user `8fcc9424a8984a3db449c23bb5908eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:16.687358 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-083e1c60-7224-4a61-9a2e-d05ec7734636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:16.753651 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 495/996] 10.222.0.60 () {58 vars in 1061 bytes} [Fri Aug 19 14:44:16 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:16.761177 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713792d-59d1-416f-a4f9-aa1094020a98 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:16.772470 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713792d-59d1-416f-a4f9-aa1094020a98 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:16.776817 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d60b1a-1c46-499e-b3d0-906aafc89b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fcc9424a8984a3db449c23bb5908eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:16.777445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d60b1a-1c46-499e-b3d0-906aafc89b0a service cinder] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:16.777730 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d60b1a-1c46-499e-b3d0-906aafc89b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:16.777993 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d60b1a-1c46-499e-b3d0-906aafc89b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:16.788030 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d60b1a-1c46-499e-b3d0-906aafc89b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:16.789604 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d60b1a-1c46-499e-b3d0-906aafc89b0a service cinder] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:16.799896 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 502/997] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:17.476232 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c580b-5000-4463-81f1-1c564a6a9884 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:17.477138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c580b-5000-4463-81f1-1c564a6a9884 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:17.477550 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c580b-5000-4463-81f1-1c564a6a9884 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:17.480727 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 496/998] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:17.487591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43ecc3-0155-4efa-bfd5-5f422952384d None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:17.490330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43ecc3-0155-4efa-bfd5-5f422952384d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:17.490868 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43ecc3-0155-4efa-bfd5-5f422952384d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:17.513673 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-7b43ecc3-0155-4efa-bfd5-5f422952384d None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:17.515133 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-7b43ecc3-0155-4efa-bfd5-5f422952384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:17.523655 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 503/999] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:17.870863 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c580b-5000-4463-81f1-1c564a6a9884 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:17.900953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c580b-5000-4463-81f1-1c564a6a9884 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:17.907518 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8e6f0-2602-46dd-9429-8bdc9c01223d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:17.908505 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e6f0-2602-46dd-9429-8bdc9c01223d service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:17.908953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e6f0-2602-46dd-9429-8bdc9c01223d service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:17.909489 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e6f0-2602-46dd-9429-8bdc9c01223d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:17.924543 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8e6f0-2602-46dd-9429-8bdc9c01223d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:17.926604 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8e6f0-2602-46dd-9429-8bdc9c01223d service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:17.938398 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:44:17.956221 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 497/1000] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 14:44:20.270389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8927a-1190-40ed-9903-fa9e154869cc None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:20.271008 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8927a-1190-40ed-9903-fa9e154869cc None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:20.271008 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8927a-1190-40ed-9903-fa9e154869cc None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:20.272567 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 504/1001] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:20.278794 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e15d5-432f-4a66-b73b-a86011dad8c3 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:20.279468 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e15d5-432f-4a66-b73b-a86011dad8c3 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:20.279468 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e15d5-432f-4a66-b73b-a86011dad8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:20.311010 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-968e15d5-432f-4a66-b73b-a86011dad8c3 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:20.312802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-968e15d5-432f-4a66-b73b-a86011dad8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:20.335399 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 498/1002] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:20.691945 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8927a-1190-40ed-9903-fa9e154869cc None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:20.713080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8927a-1190-40ed-9903-fa9e154869cc None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:20.718650 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff28e7f-ac34-4335-8899-ec711ed847ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:20.719260 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff28e7f-ac34-4335-8899-ec711ed847ae service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:20.719539 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff28e7f-ac34-4335-8899-ec711ed847ae service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:20.719806 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff28e7f-ac34-4335-8899-ec711ed847ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:20.729057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff28e7f-ac34-4335-8899-ec711ed847ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:20.731030 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff28e7f-ac34-4335-8899-ec711ed847ae service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:20.743124 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 505/1003] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:23.175775 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28922-9b72-4340-ab42-4b0afb7c05b6 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:23.176258 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28922-9b72-4340-ab42-4b0afb7c05b6 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:23.176373 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28922-9b72-4340-ab42-4b0afb7c05b6 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:23.177658 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 499/1004] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:23.183423 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51a86-820e-4f47-8f40-cd27ee83de2f None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:23.184115 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51a86-820e-4f47-8f40-cd27ee83de2f None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:23.184115 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51a86-820e-4f47-8f40-cd27ee83de2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:23.204894 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-11e51a86-820e-4f47-8f40-cd27ee83de2f None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:23.206123 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-11e51a86-820e-4f47-8f40-cd27ee83de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:23.216726 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 506/1005] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:23.587154 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28922-9b72-4340-ab42-4b0afb7c05b6 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:23.602585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28922-9b72-4340-ab42-4b0afb7c05b6 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:23.609001 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49585f5-4fdc-42c9-9acd-46d9ad501441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:23.610003 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49585f5-4fdc-42c9-9acd-46d9ad501441 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:23.610416 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49585f5-4fdc-42c9-9acd-46d9ad501441 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:23.610712 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49585f5-4fdc-42c9-9acd-46d9ad501441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:23.620379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49585f5-4fdc-42c9-9acd-46d9ad501441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:23.622340 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49585f5-4fdc-42c9-9acd-46d9ad501441 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:23.633983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 500/1006] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:25.892871 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcf05c-e7c7-478c-9ad8-eb49fd12db37 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:25.893459 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcf05c-e7c7-478c-9ad8-eb49fd12db37 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:25.893654 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcf05c-e7c7-478c-9ad8-eb49fd12db37 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:25.895975 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 507/1007] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:25.908450 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df9b6-1a00-4c00-9bcc-2ead8a48cd8a None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:25.909620 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df9b6-1a00-4c00-9bcc-2ead8a48cd8a None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:25.909620 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df9b6-1a00-4c00-9bcc-2ead8a48cd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:25.937851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-385df9b6-1a00-4c00-9bcc-2ead8a48cd8a None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:25.939483 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-385df9b6-1a00-4c00-9bcc-2ead8a48cd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:25.950884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 501/1008] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 14:44:26.325149 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcf05c-e7c7-478c-9ad8-eb49fd12db37 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:26.341060 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcf05c-e7c7-478c-9ad8-eb49fd12db37 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:26.347681 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f1334-6bf7-4cf1-bfce-a00956b27f9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:26.348404 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1334-6bf7-4cf1-bfce-a00956b27f9d service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:26.348733 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1334-6bf7-4cf1-bfce-a00956b27f9d service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:26.348999 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1334-6bf7-4cf1-bfce-a00956b27f9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:26.363622 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f1334-6bf7-4cf1-bfce-a00956b27f9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:26.366338 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f1334-6bf7-4cf1-bfce-a00956b27f9d service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:26.383206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 508/1009] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:29.042465 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb14ff-4bc0-480a-a335-53baafc0b8dd None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:29.043317 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb14ff-4bc0-480a-a335-53baafc0b8dd None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:29.043317 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb14ff-4bc0-480a-a335-53baafc0b8dd None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:29.045148 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 502/1010] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:29.056260 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699bd28-e746-4212-8745-5c27f315536d None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:29.056860 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699bd28-e746-4212-8745-5c27f315536d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:29.056971 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699bd28-e746-4212-8745-5c27f315536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:29.071651 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=43 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:44:29.087105 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-7699bd28-e746-4212-8745-5c27f315536d None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:29.088466 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-7699bd28-e746-4212-8745-5c27f315536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:29.100701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 509/1011] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:29.776016 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb14ff-4bc0-480a-a335-53baafc0b8dd None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:29.791234 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb14ff-4bc0-480a-a335-53baafc0b8dd None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:29.796430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310a189-ef29-4410-9199-9e0f05b480f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:29.797061 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a189-ef29-4410-9199-9e0f05b480f9 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:29.797347 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a189-ef29-4410-9199-9e0f05b480f9 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:29.797606 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a189-ef29-4410-9199-9e0f05b480f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:29.806894 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310a189-ef29-4410-9199-9e0f05b480f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:29.808498 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310a189-ef29-4410-9199-9e0f05b480f9 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:29.819789 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 503/1012] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:32.611076 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741c09-65c7-4ed4-b73c-d17ae4eb91a6 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:32.612333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741c09-65c7-4ed4-b73c-d17ae4eb91a6 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:32.612816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741c09-65c7-4ed4-b73c-d17ae4eb91a6 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:32.614516 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 510/1013] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:44:32.621441 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261a14e-eac8-454a-aa06-a58ee3463583 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:32.622128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261a14e-eac8-454a-aa06-a58ee3463583 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:32.622280 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261a14e-eac8-454a-aa06-a58ee3463583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:32.643773 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-d261a14e-eac8-454a-aa06-a58ee3463583 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:32.644891 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-d261a14e-eac8-454a-aa06-a58ee3463583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:32.652983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 504/1014] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:32.997450 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741c09-65c7-4ed4-b73c-d17ae4eb91a6 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:33.011772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741c09-65c7-4ed4-b73c-d17ae4eb91a6 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:33.017578 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9b3f7-d932-4318-8162-8a6e67727552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:33.018526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b3f7-d932-4318-8162-8a6e67727552 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:33.018526 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b3f7-d932-4318-8162-8a6e67727552 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:33.018842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b3f7-d932-4318-8162-8a6e67727552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:33.028728 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9b3f7-d932-4318-8162-8a6e67727552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:33.031163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9b3f7-d932-4318-8162-8a6e67727552 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:33.042767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 511/1015] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:33.222072 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2cc7-29ce-454a-b9ce-41dc69fc7ae7 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:33.222399 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2cc7-29ce-454a-b9ce-41dc69fc7ae7 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:33.222671 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2cc7-29ce-454a-b9ce-41dc69fc7ae7 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:33.224221 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 505/1016] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:33.230103 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863ca1-278d-4d8a-b89b-469d1687bd15 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:33.230384 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863ca1-278d-4d8a-b89b-469d1687bd15 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:33.230659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863ca1-278d-4d8a-b89b-469d1687bd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:33.253546 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-83863ca1-278d-4d8a-b89b-469d1687bd15 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:33.254858 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-83863ca1-278d-4d8a-b89b-469d1687bd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:33.263674 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 512/1017] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:33.638949 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048258bd-c737-4797-93e0-8c5403703146 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:33.639540 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048258bd-c737-4797-93e0-8c5403703146 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:33.639540 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048258bd-c737-4797-93e0-8c5403703146 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:33.640814 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 506/1018] 10.222.0.60 () {54 vars in 967 bytes} [Fri Aug 19 14:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:33.646236 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fa592-5614-41d8-b201-c9443628c65d None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:33.646737 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fa592-5614-41d8-b201-c9443628c65d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:33.646837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fa592-5614-41d8-b201-c9443628c65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:33.688581 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-998fa592-5614-41d8-b201-c9443628c65d None None] MFA Rules not processed for user `e541d55268064ad986a5d05108120f62`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:33.689828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-998fa592-5614-41d8-b201-c9443628c65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:33.759346 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 513/1019] 10.222.0.60 () {58 vars in 1064 bytes} [Fri Aug 19 14:44:33 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:33.767106 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048258bd-c737-4797-93e0-8c5403703146 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:33.779109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048258bd-c737-4797-93e0-8c5403703146 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:33.782907 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da016487-0488-4721-928f-8ed42af506ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e541d55268064ad986a5d05108120f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:33.783509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da016487-0488-4721-928f-8ed42af506ec service glance] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:33.783776 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da016487-0488-4721-928f-8ed42af506ec service glance] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:33.784036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da016487-0488-4721-928f-8ed42af506ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:33.793986 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da016487-0488-4721-928f-8ed42af506ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:33.795425 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da016487-0488-4721-928f-8ed42af506ec service glance] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:33.805223 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 507/1020] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:35.310071 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711da7-3128-4747-8375-8c8f28679fc5 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:35.310790 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711da7-3128-4747-8375-8c8f28679fc5 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:35.310790 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af711da7-3128-4747-8375-8c8f28679fc5 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:35.311908 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 514/1021] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:35.318277 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e63b62-5f92-4dae-8d49-da2a7864c1b9 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:35.318899 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e63b62-5f92-4dae-8d49-da2a7864c1b9 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:35.318899 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e63b62-5f92-4dae-8d49-da2a7864c1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:35.340662 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-d6e63b62-5f92-4dae-8d49-da2a7864c1b9 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:35.341928 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-d6e63b62-5f92-4dae-8d49-da2a7864c1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:35.353218 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 508/1022] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:35.711758 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af711da7-3128-4747-8375-8c8f28679fc5 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:35.726805 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af711da7-3128-4747-8375-8c8f28679fc5 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:35.736395 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3f947-b838-4d38-813a-cd8814ea4e2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:35.737023 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3f947-b838-4d38-813a-cd8814ea4e2c service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:35.737313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3f947-b838-4d38-813a-cd8814ea4e2c service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:35.737624 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3f947-b838-4d38-813a-cd8814ea4e2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:35.748873 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3f947-b838-4d38-813a-cd8814ea4e2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:35.750877 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3f947-b838-4d38-813a-cd8814ea4e2c service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:35.766015 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 515/1023] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:38.119803 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df93d-3322-4f4b-81c3-3855513c15d1 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:38.120531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df93d-3322-4f4b-81c3-3855513c15d1 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:38.120531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df93d-3322-4f4b-81c3-3855513c15d1 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:38.121698 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 509/1024] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:38.127782 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063af771-14ba-4e12-aedf-f231857dfcfd None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:38.128326 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063af771-14ba-4e12-aedf-f231857dfcfd None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:38.128326 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063af771-14ba-4e12-aedf-f231857dfcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:38.153626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-063af771-14ba-4e12-aedf-f231857dfcfd None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:38.154927 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-063af771-14ba-4e12-aedf-f231857dfcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:38.169218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 516/1025] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:44:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:38.539293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df93d-3322-4f4b-81c3-3855513c15d1 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:38.552639 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df93d-3322-4f4b-81c3-3855513c15d1 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:38.562947 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f27d09-36f3-4c44-a4fe-ad28c0215d30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:38.563585 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f27d09-36f3-4c44-a4fe-ad28c0215d30 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:38.563865 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f27d09-36f3-4c44-a4fe-ad28c0215d30 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:38.564134 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f27d09-36f3-4c44-a4fe-ad28c0215d30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:38.575961 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f27d09-36f3-4c44-a4fe-ad28c0215d30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:38.577840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f27d09-36f3-4c44-a4fe-ad28c0215d30 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:38.592314 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 510/1026] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:48.144370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=53 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:44:48.585084 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=37 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:44:49.547951 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d3c39-b8f6-4059-9094-94a087a7486d None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:49.548568 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d3c39-b8f6-4059-9094-94a087a7486d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:49.548568 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d3c39-b8f6-4059-9094-94a087a7486d None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:49.549808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 517/1027] 10.222.0.60 () {54 vars in 918 bytes} [Fri Aug 19 14:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:49.555743 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df046-b6bf-4d9f-af5b-51bd5fcecd98 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:49.556008 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df046-b6bf-4d9f-af5b-51bd5fcecd98 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:49.556298 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df046-b6bf-4d9f-af5b-51bd5fcecd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:49.578892 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-e46df046-b6bf-4d9f-af5b-51bd5fcecd98 None None] MFA Rules not processed for user `6000b5f82dee4ff4abb8935efd8c39df`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:49.580799 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-e46df046-b6bf-4d9f-af5b-51bd5fcecd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:49.590150 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 511/1028] 10.222.0.60 () {58 vars in 1015 bytes} [Fri Aug 19 14:44:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:49.605145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cff17-7c8b-4f78-872d-01abf32ae159 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:49.605427 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cff17-7c8b-4f78-872d-01abf32ae159 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:49.605705 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cff17-7c8b-4f78-872d-01abf32ae159 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:49.607087 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 518/1029] 10.222.0.60 () {54 vars in 918 bytes} [Fri Aug 19 14:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:49.612023 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc853-cb2f-4dcf-bf5d-904a808b0ff5 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:49.612302 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc853-cb2f-4dcf-bf5d-904a808b0ff5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:49.612568 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc853-cb2f-4dcf-bf5d-904a808b0ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:49.633222 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-878dc853-cb2f-4dcf-bf5d-904a808b0ff5 None None] MFA Rules not processed for user `c1a9ed9280d249f9a76d037ff8407082`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:49.634468 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-878dc853-cb2f-4dcf-bf5d-904a808b0ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:49.643962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 512/1030] 10.222.0.60 () {58 vars in 1015 bytes} [Fri Aug 19 14:44:49 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:52.390867 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b34b08-168a-41f0-8da0-0552c3d52de9 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:52.391921 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b34b08-168a-41f0-8da0-0552c3d52de9 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:52.391921 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b34b08-168a-41f0-8da0-0552c3d52de9 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:52.393765 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 519/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:44:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:52.405429 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012837d9-050e-43a3-aa57-7e93edad30a5 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:52.406333 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012837d9-050e-43a3-aa57-7e93edad30a5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:52.406914 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012837d9-050e-43a3-aa57-7e93edad30a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:52.431200 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-012837d9-050e-43a3-aa57-7e93edad30a5 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:52.432445 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-012837d9-050e-43a3-aa57-7e93edad30a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:52.441138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 513/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:44:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:52.798941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b34b08-168a-41f0-8da0-0552c3d52de9 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:52.814002 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b34b08-168a-41f0-8da0-0552c3d52de9 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:52.819746 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67258fc7-9032-48ff-88cf-e8b3c7d64db6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:52.820337 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67258fc7-9032-48ff-88cf-e8b3c7d64db6 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:52.820601 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67258fc7-9032-48ff-88cf-e8b3c7d64db6 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:52.820848 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67258fc7-9032-48ff-88cf-e8b3c7d64db6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:52.834932 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67258fc7-9032-48ff-88cf-e8b3c7d64db6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:52.836549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67258fc7-9032-48ff-88cf-e8b3c7d64db6 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:52.846081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 520/1033] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:53.852166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0959c-4899-47d7-a305-fd915bd5a1d5 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:53.852722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0959c-4899-47d7-a305-fd915bd5a1d5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:53.852722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0959c-4899-47d7-a305-fd915bd5a1d5 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:53.854060 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 514/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:53.859381 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb9f73-9fab-4ae1-bae9-949c6d0b616c None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:53.860009 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb9f73-9fab-4ae1-bae9-949c6d0b616c None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:53.860105 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb9f73-9fab-4ae1-bae9-949c6d0b616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:53.881368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-dabb9f73-9fab-4ae1-bae9-949c6d0b616c None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:53.882820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-dabb9f73-9fab-4ae1-bae9-949c6d0b616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:53.892867 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 521/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:44:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:54.122271 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0959c-4899-47d7-a305-fd915bd5a1d5 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:54.141944 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0959c-4899-47d7-a305-fd915bd5a1d5 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:54.148221 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a73c85-ce33-407e-8c6e-4668cf5cfb99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:54.149087 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a73c85-ce33-407e-8c6e-4668cf5cfb99 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:54.149374 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a73c85-ce33-407e-8c6e-4668cf5cfb99 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:54.149647 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a73c85-ce33-407e-8c6e-4668cf5cfb99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:54.158820 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a73c85-ce33-407e-8c6e-4668cf5cfb99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:54.160937 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a73c85-ce33-407e-8c6e-4668cf5cfb99 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:54.173176 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 515/1036] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:55.136971 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7164d-3526-4ce6-9f94-c0b0c8efe224 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:55.137558 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7164d-3526-4ce6-9f94-c0b0c8efe224 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:55.137558 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7164d-3526-4ce6-9f94-c0b0c8efe224 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:55.138880 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 522/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:55.143976 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85e5a4-9f40-402f-9ede-f1e9904c91ad None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:55.144433 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85e5a4-9f40-402f-9ede-f1e9904c91ad None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:55.144531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85e5a4-9f40-402f-9ede-f1e9904c91ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:55.166581 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-6d85e5a4-9f40-402f-9ede-f1e9904c91ad None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:55.167785 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-6d85e5a4-9f40-402f-9ede-f1e9904c91ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:55.175662 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 516/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:44:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:55.343026 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7164d-3526-4ce6-9f94-c0b0c8efe224 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:55.360816 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7164d-3526-4ce6-9f94-c0b0c8efe224 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:55.366561 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f436d5-8da5-4d0d-8ac0-c40fe20f51b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:55.367172 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f436d5-8da5-4d0d-8ac0-c40fe20f51b7 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:55.367454 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f436d5-8da5-4d0d-8ac0-c40fe20f51b7 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:55.367698 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f436d5-8da5-4d0d-8ac0-c40fe20f51b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:55.377072 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f436d5-8da5-4d0d-8ac0-c40fe20f51b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:55.378719 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f436d5-8da5-4d0d-8ac0-c40fe20f51b7 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:55.389378 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 523/1039] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:56.273850 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0659d-415a-4e66-a541-6e5a43b60c5d None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:56.274567 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0659d-415a-4e66-a541-6e5a43b60c5d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:56.274567 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0659d-415a-4e66-a541-6e5a43b60c5d None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:56.275763 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 517/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:56.291409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a995da-53a2-474e-b6b4-46d9dcbfada1 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:56.291943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a995da-53a2-474e-b6b4-46d9dcbfada1 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:56.291943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a995da-53a2-474e-b6b4-46d9dcbfada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:56.313289 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-c3a995da-53a2-474e-b6b4-46d9dcbfada1 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:56.314536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-c3a995da-53a2-474e-b6b4-46d9dcbfada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:56.324472 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 524/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:44:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:56.489943 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0659d-415a-4e66-a541-6e5a43b60c5d None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:56.504541 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0659d-415a-4e66-a541-6e5a43b60c5d None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:56.510174 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e047360-17f8-4c8c-9f3d-6f8bbb6b3606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:56.510785 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047360-17f8-4c8c-9f3d-6f8bbb6b3606 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:56.511061 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047360-17f8-4c8c-9f3d-6f8bbb6b3606 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:56.511332 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047360-17f8-4c8c-9f3d-6f8bbb6b3606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:56.519993 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e047360-17f8-4c8c-9f3d-6f8bbb6b3606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:56.521857 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e047360-17f8-4c8c-9f3d-6f8bbb6b3606 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:56.531997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 518/1042] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:57.427095 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a583a-73ef-43c3-93ae-ab94f3e57686 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:57.427738 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a583a-73ef-43c3-93ae-ab94f3e57686 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:57.427738 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a583a-73ef-43c3-93ae-ab94f3e57686 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:57.431320 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 525/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:57.435316 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda132a9-01c5-4f70-b3f0-6b7c760d39e1 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:57.436088 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda132a9-01c5-4f70-b3f0-6b7c760d39e1 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:57.436303 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda132a9-01c5-4f70-b3f0-6b7c760d39e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:57.464844 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-fda132a9-01c5-4f70-b3f0-6b7c760d39e1 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:57.466079 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-fda132a9-01c5-4f70-b3f0-6b7c760d39e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:57.476134 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 519/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:44:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:57.647924 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a583a-73ef-43c3-93ae-ab94f3e57686 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:57.672752 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a583a-73ef-43c3-93ae-ab94f3e57686 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:57.678013 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a5b02-fade-4c66-bbe2-ff58edcb2e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:57.678781 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5b02-fade-4c66-bbe2-ff58edcb2e22 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:57.679051 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5b02-fade-4c66-bbe2-ff58edcb2e22 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:57.679311 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5b02-fade-4c66-bbe2-ff58edcb2e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:57.687834 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a5b02-fade-4c66-bbe2-ff58edcb2e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:57.689432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a5b02-fade-4c66-bbe2-ff58edcb2e22 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:57.701097 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 526/1045] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:58.538038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e37a3-2a58-4535-9394-cc9750edf125 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:58.538859 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e37a3-2a58-4535-9394-cc9750edf125 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:58.539131 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e37a3-2a58-4535-9394-cc9750edf125 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:58.540507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 520/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:58.546805 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a91a9f-8aee-4efb-acb9-d7a0acdc9e0f None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:58.547258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a91a9f-8aee-4efb-acb9-d7a0acdc9e0f None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:58.547362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a91a9f-8aee-4efb-acb9-d7a0acdc9e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:58.576787 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-78a91a9f-8aee-4efb-acb9-d7a0acdc9e0f None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:58.578663 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-78a91a9f-8aee-4efb-acb9-d7a0acdc9e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:58.592956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 527/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:44:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:58.759330 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e37a3-2a58-4535-9394-cc9750edf125 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:58.780103 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e37a3-2a58-4535-9394-cc9750edf125 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:58.786398 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b0e86-1c45-4c4b-84c8-281c139d9323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:58.787015 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b0e86-1c45-4c4b-84c8-281c139d9323 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:58.787455 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b0e86-1c45-4c4b-84c8-281c139d9323 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:58.787722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b0e86-1c45-4c4b-84c8-281c139d9323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:58.799224 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b0e86-1c45-4c4b-84c8-281c139d9323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:58.802163 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b0e86-1c45-4c4b-84c8-281c139d9323 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:58.818603 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 521/1048] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:44:59.640272 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bac64-eb7f-4c37-92d6-077f27ef0dbf None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:59.640809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bac64-eb7f-4c37-92d6-077f27ef0dbf None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:59.640809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bac64-eb7f-4c37-92d6-077f27ef0dbf None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:59.642589 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 528/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:44:59.649495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192edfd-fb32-4c29-82da-d85313139ccd None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:59.649993 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192edfd-fb32-4c29-82da-d85313139ccd None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:59.650110 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192edfd-fb32-4c29-82da-d85313139ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:59.669949 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-5192edfd-fb32-4c29-82da-d85313139ccd None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:44:59.671182 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-5192edfd-fb32-4c29-82da-d85313139ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:44:59.680301 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 522/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:44:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:44:59.837340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bac64-eb7f-4c37-92d6-077f27ef0dbf None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:44:59.852897 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bac64-eb7f-4c37-92d6-077f27ef0dbf None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:44:59.858371 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cb0ac-77c3-4cb6-85a0-b56aa81fdc20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:44:59.858995 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cb0ac-77c3-4cb6-85a0-b56aa81fdc20 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:44:59.859269 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cb0ac-77c3-4cb6-85a0-b56aa81fdc20 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:44:59.859536 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cb0ac-77c3-4cb6-85a0-b56aa81fdc20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:44:59.868847 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cb0ac-77c3-4cb6-85a0-b56aa81fdc20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:44:59.870589 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cb0ac-77c3-4cb6-85a0-b56aa81fdc20 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:44:59.880307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 529/1051] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:44:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:00.748651 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7793db-4e7e-4aae-9c45-7c4cdd55e99d None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:00.749286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7793db-4e7e-4aae-9c45-7c4cdd55e99d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:00.749286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7793db-4e7e-4aae-9c45-7c4cdd55e99d None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:00.750526 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 523/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:00.755586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8af9c5-774d-4cf8-a9aa-debc52a648d7 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:00.756140 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8af9c5-774d-4cf8-a9aa-debc52a648d7 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:00.756505 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8af9c5-774d-4cf8-a9aa-debc52a648d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:00.780700 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-fa8af9c5-774d-4cf8-a9aa-debc52a648d7 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:00.781951 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-fa8af9c5-774d-4cf8-a9aa-debc52a648d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:00.791769 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 530/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:45:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:00.957253 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7793db-4e7e-4aae-9c45-7c4cdd55e99d None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:00.972636 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7793db-4e7e-4aae-9c45-7c4cdd55e99d None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:00.978455 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc91784-ffa4-47c1-8abc-dac826cf458f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:00.979067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc91784-ffa4-47c1-8abc-dac826cf458f service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:00.979359 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc91784-ffa4-47c1-8abc-dac826cf458f service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:00.979618 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc91784-ffa4-47c1-8abc-dac826cf458f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:00.988143 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc91784-ffa4-47c1-8abc-dac826cf458f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:00.989770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc91784-ffa4-47c1-8abc-dac826cf458f service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:00.999642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 524/1054] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:01.808766 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a05e-2c30-4016-b9e8-71e33fc938ba None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:01.809367 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a05e-2c30-4016-b9e8-71e33fc938ba None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:01.809367 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a05e-2c30-4016-b9e8-71e33fc938ba None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:01.810764 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 531/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:01.815980 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704d4cd-5657-4110-94e0-e920fc7a73b0 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:01.816511 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704d4cd-5657-4110-94e0-e920fc7a73b0 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:01.816511 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704d4cd-5657-4110-94e0-e920fc7a73b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:01.841136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-3704d4cd-5657-4110-94e0-e920fc7a73b0 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:01.842515 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-3704d4cd-5657-4110-94e0-e920fc7a73b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:01.850906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 525/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:45:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:02.013770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897a05e-2c30-4016-b9e8-71e33fc938ba None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:02.028670 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897a05e-2c30-4016-b9e8-71e33fc938ba None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:02.034787 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0e57b-35e0-4911-8912-2da2f8aee402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:02.035803 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0e57b-35e0-4911-8912-2da2f8aee402 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:02.036084 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0e57b-35e0-4911-8912-2da2f8aee402 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:02.036347 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0e57b-35e0-4911-8912-2da2f8aee402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:02.048366 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0e57b-35e0-4911-8912-2da2f8aee402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:02.050042 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0e57b-35e0-4911-8912-2da2f8aee402 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:02.061236 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 532/1057] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:04.150026 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77d433-e3c6-4159-9f59-c7b86af79b83 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:04.150596 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77d433-e3c6-4159-9f59-c7b86af79b83 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:04.150596 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77d433-e3c6-4159-9f59-c7b86af79b83 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:04.151908 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 526/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:04.158149 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8da7db-d2a7-4a30-a71c-b0a063712a32 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:04.158658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8da7db-d2a7-4a30-a71c-b0a063712a32 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:04.158658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8da7db-d2a7-4a30-a71c-b0a063712a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:04.183054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-2c8da7db-d2a7-4a30-a71c-b0a063712a32 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:04.184285 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-2c8da7db-d2a7-4a30-a71c-b0a063712a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:04.193719 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 533/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:04.531121 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77d433-e3c6-4159-9f59-c7b86af79b83 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:04.544607 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77d433-e3c6-4159-9f59-c7b86af79b83 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:04.549125 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628a062-fdf4-446d-9d09-8813ee7d8d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:04.549734 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628a062-fdf4-446d-9d09-8813ee7d8d44 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:04.550043 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628a062-fdf4-446d-9d09-8813ee7d8d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:04.550317 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628a062-fdf4-446d-9d09-8813ee7d8d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:04.562379 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628a062-fdf4-446d-9d09-8813ee7d8d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:04.563959 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628a062-fdf4-446d-9d09-8813ee7d8d44 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:04.574646 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 527/1060] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:06.938253 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730095f-7a0f-48ce-ad87-94df06d1da10 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:06.938855 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730095f-7a0f-48ce-ad87-94df06d1da10 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:06.938855 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730095f-7a0f-48ce-ad87-94df06d1da10 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:06.940357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 534/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:06.946739 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc43e1-e707-4da3-aa50-072dbcbd7a37 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:06.947186 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc43e1-e707-4da3-aa50-072dbcbd7a37 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:06.947285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc43e1-e707-4da3-aa50-072dbcbd7a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:06.970410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-fcfc43e1-e707-4da3-aa50-072dbcbd7a37 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:06.972035 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-fcfc43e1-e707-4da3-aa50-072dbcbd7a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:06.981167 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 528/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:45:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:07.316485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730095f-7a0f-48ce-ad87-94df06d1da10 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:07.332496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730095f-7a0f-48ce-ad87-94df06d1da10 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:07.336804 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdfd34-e1e5-467e-b7f8-034c1cfcdf77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:07.337410 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfd34-e1e5-467e-b7f8-034c1cfcdf77 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:07.337680 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfd34-e1e5-467e-b7f8-034c1cfcdf77 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:07.337954 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfd34-e1e5-467e-b7f8-034c1cfcdf77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:07.348465 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdfd34-e1e5-467e-b7f8-034c1cfcdf77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:07.349995 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdfd34-e1e5-467e-b7f8-034c1cfcdf77 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:07.359938 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 535/1063] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:09.895496 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35142b0-db79-485d-89d4-9a3148da9c52 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:09.896092 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35142b0-db79-485d-89d4-9a3148da9c52 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:09.896092 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35142b0-db79-485d-89d4-9a3148da9c52 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:09.897653 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 529/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:09.903211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fa54b-47f0-4acb-a673-46b03e5919b4 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:09.903671 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fa54b-47f0-4acb-a673-46b03e5919b4 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:09.903787 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fa54b-47f0-4acb-a673-46b03e5919b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:09.923333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-c04fa54b-47f0-4acb-a673-46b03e5919b4 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:09.924525 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-c04fa54b-47f0-4acb-a673-46b03e5919b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:09.932961 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 536/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:45:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:10.273426 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35142b0-db79-485d-89d4-9a3148da9c52 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:10.291317 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35142b0-db79-485d-89d4-9a3148da9c52 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:10.295696 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973971bf-4c32-4291-ba88-0c271a8ea7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:10.296303 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973971bf-4c32-4291-ba88-0c271a8ea7bb service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:10.296575 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973971bf-4c32-4291-ba88-0c271a8ea7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:10.296842 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973971bf-4c32-4291-ba88-0c271a8ea7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:10.308105 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973971bf-4c32-4291-ba88-0c271a8ea7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:10.310775 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973971bf-4c32-4291-ba88-0c271a8ea7bb service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:10.323296 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 530/1066] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:12.663047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3d0f-f1cb-4a58-b93f-fcbb719346a1 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:12.663584 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3d0f-f1cb-4a58-b93f-fcbb719346a1 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:12.663584 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3d0f-f1cb-4a58-b93f-fcbb719346a1 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:12.664836 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 537/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:12.670720 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b425f8-12c5-46ae-a2d4-3bd8a1ae96bc None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:12.671218 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b425f8-12c5-46ae-a2d4-3bd8a1ae96bc None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:12.671340 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b425f8-12c5-46ae-a2d4-3bd8a1ae96bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:12.691583 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-44b425f8-12c5-46ae-a2d4-3bd8a1ae96bc None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:12.693184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-44b425f8-12c5-46ae-a2d4-3bd8a1ae96bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:12.701619 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 531/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:45:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:13.041904 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3d0f-f1cb-4a58-b93f-fcbb719346a1 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:13.053617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3d0f-f1cb-4a58-b93f-fcbb719346a1 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:13.057263 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad408e-8320-4edc-8e87-85d8f39652a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:13.057862 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad408e-8320-4edc-8e87-85d8f39652a6 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:13.058168 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad408e-8320-4edc-8e87-85d8f39652a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:13.058438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad408e-8320-4edc-8e87-85d8f39652a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:13.068596 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad408e-8320-4edc-8e87-85d8f39652a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:13.070091 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad408e-8320-4edc-8e87-85d8f39652a6 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:13.080389 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 538/1069] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:15.423604 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0030e-afd2-4988-a350-20ed252f2854 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:15.424149 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0030e-afd2-4988-a350-20ed252f2854 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:15.424149 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0030e-afd2-4988-a350-20ed252f2854 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:15.425465 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 532/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:15.431370 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f48d98-bd19-4870-a78e-59f7792c7059 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:15.431813 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f48d98-bd19-4870-a78e-59f7792c7059 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:15.431905 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f48d98-bd19-4870-a78e-59f7792c7059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:15.452749 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-17f48d98-bd19-4870-a78e-59f7792c7059 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:15.453951 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-17f48d98-bd19-4870-a78e-59f7792c7059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:15.462583 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 539/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:45:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:15.814781 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0030e-afd2-4988-a350-20ed252f2854 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:15.828706 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0030e-afd2-4988-a350-20ed252f2854 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:15.832819 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40965-4ce3-4ac5-a7b8-03e38c3c9eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:15.833430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40965-4ce3-4ac5-a7b8-03e38c3c9eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:15.833862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40965-4ce3-4ac5-a7b8-03e38c3c9eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:15.834165 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40965-4ce3-4ac5-a7b8-03e38c3c9eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:15.845018 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de40965-4ce3-4ac5-a7b8-03e38c3c9eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:15.846582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de40965-4ce3-4ac5-a7b8-03e38c3c9eb7 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:15.857253 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 533/1072] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:18.167515 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bf83-be9e-4374-a761-a8ab775bbdec None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:18.168340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bf83-be9e-4374-a761-a8ab775bbdec None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:18.168340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bf83-be9e-4374-a761-a8ab775bbdec None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:18.170343 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 540/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:18.176401 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30795d41-0c1f-45a8-b80c-17b5ccd7edfd None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:18.176879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30795d41-0c1f-45a8-b80c-17b5ccd7edfd None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:18.176993 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30795d41-0c1f-45a8-b80c-17b5ccd7edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:18.198069 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-30795d41-0c1f-45a8-b80c-17b5ccd7edfd None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:18.199281 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-30795d41-0c1f-45a8-b80c-17b5ccd7edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:18.208406 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 534/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:45:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:18.563560 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bf83-be9e-4374-a761-a8ab775bbdec None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:18.571770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=64 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:45:18.579053 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bf83-be9e-4374-a761-a8ab775bbdec None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:18.582882 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bc068-2517-473f-889b-bc3546f14676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:18.583489 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bc068-2517-473f-889b-bc3546f14676 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:18.583766 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bc068-2517-473f-889b-bc3546f14676 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:18.584032 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bc068-2517-473f-889b-bc3546f14676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:18.594301 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bc068-2517-473f-889b-bc3546f14676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:18.595798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bc068-2517-473f-889b-bc3546f14676 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:18.606084 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 541/1075] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:20.905199 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6802f4-00c8-4d79-88f1-4c7c79ff3bcd None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:20.906099 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6802f4-00c8-4d79-88f1-4c7c79ff3bcd None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:20.906099 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6802f4-00c8-4d79-88f1-4c7c79ff3bcd None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:20.908195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 535/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:20.914422 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40920512-faef-4870-957f-1d32f8ceaa95 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:20.915047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40920512-faef-4870-957f-1d32f8ceaa95 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:20.915158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40920512-faef-4870-957f-1d32f8ceaa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:20.939670 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-40920512-faef-4870-957f-1d32f8ceaa95 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:20.940891 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-40920512-faef-4870-957f-1d32f8ceaa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:20.950293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 542/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:45:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:21.299889 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6802f4-00c8-4d79-88f1-4c7c79ff3bcd None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:21.307297 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=73 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:45:21.314462 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6802f4-00c8-4d79-88f1-4c7c79ff3bcd None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:21.318761 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4e73-9dd4-4c28-be07-47db78e942d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:21.319377 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4e73-9dd4-4c28-be07-47db78e942d3 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:21.319675 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4e73-9dd4-4c28-be07-47db78e942d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:21.319948 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4e73-9dd4-4c28-be07-47db78e942d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:21.329303 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df4e73-9dd4-4c28-be07-47db78e942d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:21.330768 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df4e73-9dd4-4c28-be07-47db78e942d3 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:21.341064 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 536/1078] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:23.589903 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d77b8-fc73-4f59-a05b-c42704bae2ce None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:23.590778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d77b8-fc73-4f59-a05b-c42704bae2ce None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:23.590778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d77b8-fc73-4f59-a05b-c42704bae2ce None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:23.591839 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 543/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:23.597629 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bda80-4294-4553-b00b-979d4914f3d3 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:23.598429 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bda80-4294-4553-b00b-979d4914f3d3 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:23.598429 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bda80-4294-4553-b00b-979d4914f3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:23.620721 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-2a1bda80-4294-4553-b00b-979d4914f3d3 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:23.621946 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-2a1bda80-4294-4553-b00b-979d4914f3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:23.632084 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 537/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:45:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:23.968428 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d77b8-fc73-4f59-a05b-c42704bae2ce None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:23.980470 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d77b8-fc73-4f59-a05b-c42704bae2ce None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:23.984375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5775ebd-0c49-4603-86fb-4f331af5ebcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:23.984976 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5775ebd-0c49-4603-86fb-4f331af5ebcf service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:23.985254 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5775ebd-0c49-4603-86fb-4f331af5ebcf service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:23.985524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5775ebd-0c49-4603-86fb-4f331af5ebcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:23.995713 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5775ebd-0c49-4603-86fb-4f331af5ebcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:23.997160 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5775ebd-0c49-4603-86fb-4f331af5ebcf service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:24.007453 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 544/1081] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:26.275107 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b77d8-0649-4d32-8ed6-2465126a28ea None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:26.275681 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b77d8-0649-4d32-8ed6-2465126a28ea None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:26.276006 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b77d8-0649-4d32-8ed6-2465126a28ea None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:26.278354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 538/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:45:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:26.283788 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac826d-5953-4d86-b6e8-e426deab8377 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:26.284327 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac826d-5953-4d86-b6e8-e426deab8377 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:26.284327 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac826d-5953-4d86-b6e8-e426deab8377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:26.306078 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-a3ac826d-5953-4d86-b6e8-e426deab8377 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:26.307842 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-a3ac826d-5953-4d86-b6e8-e426deab8377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:26.318578 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 545/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:45:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:26.665852 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b77d8-0649-4d32-8ed6-2465126a28ea None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:26.679151 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b77d8-0649-4d32-8ed6-2465126a28ea None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:26.683612 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1644bf1-5202-43b4-ab59-d800c4c193b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:26.684231 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644bf1-5202-43b4-ab59-d800c4c193b8 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:26.684508 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644bf1-5202-43b4-ab59-d800c4c193b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:26.684777 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644bf1-5202-43b4-ab59-d800c4c193b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:26.695722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1644bf1-5202-43b4-ab59-d800c4c193b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:26.697170 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1644bf1-5202-43b4-ab59-d800c4c193b8 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:26.707477 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 539/1084] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:28.983925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616677-6e11-47c6-81ad-247ba62874e9 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:28.984814 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616677-6e11-47c6-81ad-247ba62874e9 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:28.985093 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28616677-6e11-47c6-81ad-247ba62874e9 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:28.986722 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 546/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:28.996667 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b7b05-649a-4f48-b266-83c3f7b83d71 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:28.997237 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b7b05-649a-4f48-b266-83c3f7b83d71 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:28.997237 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b7b05-649a-4f48-b266-83c3f7b83d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:29.020803 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-ab0b7b05-649a-4f48-b266-83c3f7b83d71 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:29.022058 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-ab0b7b05-649a-4f48-b266-83c3f7b83d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:29.031490 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 540/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:45:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:29.406437 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28616677-6e11-47c6-81ad-247ba62874e9 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:29.421950 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28616677-6e11-47c6-81ad-247ba62874e9 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:29.427512 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131f2f4-aa4f-47ac-a963-9635d97977d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:29.428135 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131f2f4-aa4f-47ac-a963-9635d97977d1 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:29.428409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131f2f4-aa4f-47ac-a963-9635d97977d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:29.428677 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131f2f4-aa4f-47ac-a963-9635d97977d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:29.442098 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131f2f4-aa4f-47ac-a963-9635d97977d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:29.443721 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131f2f4-aa4f-47ac-a963-9635d97977d1 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:29.454585 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 547/1087] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:39.015272 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=17 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:45:39.449613 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=23 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:45:53.891817 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f0730-6d8d-48e8-bb63-a4119f4349d7 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:53.892691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f0730-6d8d-48e8-bb63-a4119f4349d7 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:53.892691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f0730-6d8d-48e8-bb63-a4119f4349d7 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:53.894136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 541/1088] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:53.899820 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b24cd-5fab-4966-8216-999bc394ece3 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:53.900340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b24cd-5fab-4966-8216-999bc394ece3 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:53.900340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b24cd-5fab-4966-8216-999bc394ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:53.923186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-700b24cd-5fab-4966-8216-999bc394ece3 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:53.924419 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-700b24cd-5fab-4966-8216-999bc394ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:53.933590 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 548/1089] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:45:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:54.293701 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865155-35d1-4df8-aacb-f43120d43513 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:54.294020 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865155-35d1-4df8-aacb-f43120d43513 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:54.294290 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865155-35d1-4df8-aacb-f43120d43513 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:54.295680 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 542/1090] 10.222.0.60 () {54 vars in 967 bytes} [Fri Aug 19 14:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:54.301210 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e405077-3511-47f1-8f90-ae2bf4335395 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:54.301494 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e405077-3511-47f1-8f90-ae2bf4335395 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:54.301789 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e405077-3511-47f1-8f90-ae2bf4335395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:54.323753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-1e405077-3511-47f1-8f90-ae2bf4335395 None None] MFA Rules not processed for user `e541d55268064ad986a5d05108120f62`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:54.325059 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-1e405077-3511-47f1-8f90-ae2bf4335395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:54.333224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 549/1091] 10.222.0.60 () {58 vars in 1064 bytes} [Fri Aug 19 14:45:54 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:54.341000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865155-35d1-4df8-aacb-f43120d43513 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:54.358422 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865155-35d1-4df8-aacb-f43120d43513 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:54.364195 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b920a-1b2d-4f89-9472-f17787f0d68c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e541d55268064ad986a5d05108120f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:54.364821 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b920a-1b2d-4f89-9472-f17787f0d68c service glance] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:54.365113 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b920a-1b2d-4f89-9472-f17787f0d68c service glance] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:54.365372 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b920a-1b2d-4f89-9472-f17787f0d68c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:54.375323 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b920a-1b2d-4f89-9472-f17787f0d68c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:54.376757 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b920a-1b2d-4f89-9472-f17787f0d68c service glance] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:54.387394 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 543/1092] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:45:56.729580 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523765f2-d9f0-42e9-b983-2ab014cbb820 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:56.730158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523765f2-d9f0-42e9-b983-2ab014cbb820 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:56.730158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523765f2-d9f0-42e9-b983-2ab014cbb820 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:56.731671 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 550/1093] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:56.737769 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920a0a8-224c-42a2-955f-2e5747955dac None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:56.738303 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920a0a8-224c-42a2-955f-2e5747955dac None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:56.738303 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920a0a8-224c-42a2-955f-2e5747955dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:56.759634 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-e920a0a8-224c-42a2-955f-2e5747955dac None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:56.760836 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-e920a0a8-224c-42a2-955f-2e5747955dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:56.771203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 544/1094] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:45:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:57.108145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523765f2-d9f0-42e9-b983-2ab014cbb820 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:57.122310 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523765f2-d9f0-42e9-b983-2ab014cbb820 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:57.128589 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953563bf-bde2-4119-ab0f-1dbf8858aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:57.129762 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953563bf-bde2-4119-ab0f-1dbf8858aeef admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:57.129762 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953563bf-bde2-4119-ab0f-1dbf8858aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:57.130084 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953563bf-bde2-4119-ab0f-1dbf8858aeef admin admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:57.130686 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953563bf-bde2-4119-ab0f-1dbf8858aeef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:57.132452 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: WARNING py.warnings [None req-953563bf-bde2-4119-ab0f-1dbf8858aeef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:45:57.132452 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: warnings.warn(msg) Aug 19 14:45:57.132452 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: Aug 19 14:45:57.133781 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953563bf-bde2-4119-ab0f-1dbf8858aeef admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:57.154054 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 551/1095] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Aug 19 14:45:57 2022] GET /identity/v3/projects => generated 1606 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:45:59.387881 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352304-044e-4372-a4f1-773bcbb302cb None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:59.388718 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352304-044e-4372-a4f1-773bcbb302cb None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:59.388718 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352304-044e-4372-a4f1-773bcbb302cb None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:59.390903 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 545/1096] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:45:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:45:59.397865 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0303-43d4-4708-bfdc-7ab83128a47c None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:59.398424 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0303-43d4-4708-bfdc-7ab83128a47c None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:59.398424 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0303-43d4-4708-bfdc-7ab83128a47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:59.419432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-658a0303-43d4-4708-bfdc-7ab83128a47c None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:45:59.420669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-658a0303-43d4-4708-bfdc-7ab83128a47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:45:59.430278 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 552/1097] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:45:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:45:59.786830 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9352304-044e-4372-a4f1-773bcbb302cb None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:45:59.802131 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9352304-044e-4372-a4f1-773bcbb302cb None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:45:59.807776 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd2b1-12b9-4f48-b4de-2313a3b54358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:45:59.808562 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd2b1-12b9-4f48-b4de-2313a3b54358 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:45:59.808879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd2b1-12b9-4f48-b4de-2313a3b54358 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:45:59.809185 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd2b1-12b9-4f48-b4de-2313a3b54358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:45:59.819840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd2b1-12b9-4f48-b4de-2313a3b54358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:45:59.821439 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd2b1-12b9-4f48-b4de-2313a3b54358 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:45:59.832626 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 546/1098] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:45:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:46:02.318234 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8dd08-48bc-40b8-a2f5-951bb25c05fb None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:02.318837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8dd08-48bc-40b8-a2f5-951bb25c05fb None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:02.318837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8dd08-48bc-40b8-a2f5-951bb25c05fb None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:02.320155 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 553/1099] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:46:02.326365 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953406-2ed1-42c6-b3df-ae1289e40724 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:02.326889 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953406-2ed1-42c6-b3df-ae1289e40724 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:02.326889 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953406-2ed1-42c6-b3df-ae1289e40724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:02.347153 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-f6953406-2ed1-42c6-b3df-ae1289e40724 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:46:02.348601 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-f6953406-2ed1-42c6-b3df-ae1289e40724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:46:02.357145 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 547/1100] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:46:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:46:02.702468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8dd08-48bc-40b8-a2f5-951bb25c05fb None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:46:02.718512 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8dd08-48bc-40b8-a2f5-951bb25c05fb None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:46:02.723019 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f733d-ef9e-44fa-8fc2-71b3376d4a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:46:02.723631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f733d-ef9e-44fa-8fc2-71b3376d4a8a service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:02.723899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f733d-ef9e-44fa-8fc2-71b3376d4a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:02.724162 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f733d-ef9e-44fa-8fc2-71b3376d4a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:02.741153 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f733d-ef9e-44fa-8fc2-71b3376d4a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:46:02.743027 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f733d-ef9e-44fa-8fc2-71b3376d4a8a service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:46:02.756170 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 554/1101] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:46:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:46:05.018534 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8c300-2db5-40fb-b7b7-8740751ceb6d None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:05.019134 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8c300-2db5-40fb-b7b7-8740751ceb6d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:05.019134 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8c300-2db5-40fb-b7b7-8740751ceb6d None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:05.020449 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 548/1102] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:46:05.025974 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4c322-0b76-4a92-9d22-7721d93983bb None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:05.026516 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4c322-0b76-4a92-9d22-7721d93983bb None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:05.026626 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4c322-0b76-4a92-9d22-7721d93983bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:05.047529 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-a4d4c322-0b76-4a92-9d22-7721d93983bb None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:46:05.048745 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-a4d4c322-0b76-4a92-9d22-7721d93983bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:46:05.057844 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 555/1103] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:46:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:46:05.402203 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8c300-2db5-40fb-b7b7-8740751ceb6d None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:46:05.413854 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8c300-2db5-40fb-b7b7-8740751ceb6d None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:46:05.417510 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa85a9-e5d1-4277-8887-ac2454a3a1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:46:05.418151 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa85a9-e5d1-4277-8887-ac2454a3a1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:05.418426 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa85a9-e5d1-4277-8887-ac2454a3a1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:05.418696 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa85a9-e5d1-4277-8887-ac2454a3a1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:05.428583 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa85a9-e5d1-4277-8887-ac2454a3a1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:46:05.430051 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa85a9-e5d1-4277-8887-ac2454a3a1b3 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:46:05.439847 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 549/1104] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:46:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:46:07.819211 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4c8e-f3d3-47b5-9107-84639bc32499 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:07.819808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4c8e-f3d3-47b5-9107-84639bc32499 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:07.819808 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4c8e-f3d3-47b5-9107-84639bc32499 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:07.821067 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 556/1105] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:46:07.827118 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a803-dbb2-43bc-8a14-be534631cc3a None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:07.827613 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a803-dbb2-43bc-8a14-be534631cc3a None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:07.827725 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a803-dbb2-43bc-8a14-be534631cc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:07.849639 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-1290a803-dbb2-43bc-8a14-be534631cc3a None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:46:07.850857 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-1290a803-dbb2-43bc-8a14-be534631cc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:46:07.860082 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 550/1106] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:46:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:46:08.213431 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b4c8e-f3d3-47b5-9107-84639bc32499 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:46:08.227167 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b4c8e-f3d3-47b5-9107-84639bc32499 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:46:08.231098 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ad365-727c-449f-83e0-1fbdfb035473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:46:08.231702 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ad365-727c-449f-83e0-1fbdfb035473 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:08.231975 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ad365-727c-449f-83e0-1fbdfb035473 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:08.232225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ad365-727c-449f-83e0-1fbdfb035473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:08.242312 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ad365-727c-449f-83e0-1fbdfb035473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:46:08.243774 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ad365-727c-449f-83e0-1fbdfb035473 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:46:08.253746 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 557/1107] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:46:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:46:10.663639 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4732f5-822b-44ee-b363-c94ee1cbc0fb None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:10.664219 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4732f5-822b-44ee-b363-c94ee1cbc0fb None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:10.664219 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4732f5-822b-44ee-b363-c94ee1cbc0fb None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:10.665467 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 551/1108] 10.222.0.60 () {54 vars in 927 bytes} [Fri Aug 19 14:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:46:10.671310 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6435-0670-49f6-b0ef-37794e6bb971 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:10.671800 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6435-0670-49f6-b0ef-37794e6bb971 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:10.671909 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6435-0670-49f6-b0ef-37794e6bb971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:10.692081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-441d6435-0670-49f6-b0ef-37794e6bb971 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:46:10.693331 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-441d6435-0670-49f6-b0ef-37794e6bb971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:46:10.701512 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 558/1109] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Aug 19 14:46:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:46:11.047591 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4732f5-822b-44ee-b363-c94ee1cbc0fb None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:46:11.059803 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4732f5-822b-44ee-b363-c94ee1cbc0fb None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:46:11.063865 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d01f2-010d-4dfd-acc5-ecfdcfb71c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:46:11.064474 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d01f2-010d-4dfd-acc5-ecfdcfb71c06 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:46:11.064747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d01f2-010d-4dfd-acc5-ecfdcfb71c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:46:11.065014 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d01f2-010d-4dfd-acc5-ecfdcfb71c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:46:11.075342 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d01f2-010d-4dfd-acc5-ecfdcfb71c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:46:11.076769 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d01f2-010d-4dfd-acc5-ecfdcfb71c06 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:46:11.086974 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 552/1110] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:46:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:46:20.686772 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=33 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:46:21.082762 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=33 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:47:27.129501 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084ff1d-847d-4d26-a94b-b2e45a308f9a None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.130215 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084ff1d-847d-4d26-a94b-b2e45a308f9a None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.130215 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084ff1d-847d-4d26-a94b-b2e45a308f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.152872 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-1084ff1d-847d-4d26-a94b-b2e45a308f9a None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:47:27.154910 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-1084ff1d-847d-4d26-a94b-b2e45a308f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:47:27.166607 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 559/1111] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:47:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:47:27.179110 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924987bc-86ff-4a2c-b34c-9e8e329d5a40 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.179704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924987bc-86ff-4a2c-b34c-9e8e329d5a40 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.179704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924987bc-86ff-4a2c-b34c-9e8e329d5a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.202264 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-924987bc-86ff-4a2c-b34c-9e8e329d5a40 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:47:27.203481 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-924987bc-86ff-4a2c-b34c-9e8e329d5a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:47:27.212421 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 553/1112] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:47:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:47:27.217435 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084ff1d-847d-4d26-a94b-b2e45a308f9a None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:47:27.228694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084ff1d-847d-4d26-a94b-b2e45a308f9a None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:47:27.233863 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a77a5-f0d4-4e42-b988-aca195a0cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:47:27.234559 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a77a5-f0d4-4e42-b988-aca195a0cbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.234915 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a77a5-f0d4-4e42-b988-aca195a0cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.235256 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a77a5-f0d4-4e42-b988-aca195a0cbd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.235951 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a77a5-f0d4-4e42-b988-aca195a0cbd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:47:27.236409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a77a5-f0d4-4e42-b988-aca195a0cbd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:47:27.237561 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: WARNING py.warnings [None req-8b5a77a5-f0d4-4e42-b988-aca195a0cbd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:47:27.237561 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: warnings.warn(msg) Aug 19 14:47:27.237561 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: Aug 19 14:47:27.239097 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a77a5-f0d4-4e42-b988-aca195a0cbd7 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:47:27.252702 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 560/1113] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Aug 19 14:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:47:27.261299 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924987bc-86ff-4a2c-b34c-9e8e329d5a40 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:47:27.271506 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924987bc-86ff-4a2c-b34c-9e8e329d5a40 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:47:27.276787 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63147955-568a-4cda-bfc9-e1745ee9938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:47:27.277406 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63147955-568a-4cda-bfc9-e1745ee9938c admin admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.277677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63147955-568a-4cda-bfc9-e1745ee9938c admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.277973 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63147955-568a-4cda-bfc9-e1745ee9938c admin admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.278627 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63147955-568a-4cda-bfc9-e1745ee9938c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:47:27.280439 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: WARNING py.warnings [None req-63147955-568a-4cda-bfc9-e1745ee9938c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:47:27.280439 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: warnings.warn(msg) Aug 19 14:47:27.280439 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: Aug 19 14:47:27.281633 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63147955-568a-4cda-bfc9-e1745ee9938c admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:47:27.314381 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 554/1114] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Aug 19 14:47:27 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:47:27.322138 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a77a5-f0d4-4e42-b988-aca195a0cbd7 admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:47:27.335682 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a77a5-f0d4-4e42-b988-aca195a0cbd7 admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:47:27.412197 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0db4-84c9-4112-8116-8d0c3e9826d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:47:27.412837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0db4-84c9-4112-8116-8d0c3e9826d6 admin admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.413105 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0db4-84c9-4112-8116-8d0c3e9826d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.413368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0db4-84c9-4112-8116-8d0c3e9826d6 admin admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.414169 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b0db4-84c9-4112-8116-8d0c3e9826d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:47:27.415209 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: WARNING py.warnings [None req-2f4b0db4-84c9-4112-8116-8d0c3e9826d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:47:27.415209 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: warnings.warn(msg) Aug 19 14:47:27.415209 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: Aug 19 14:47:27.416478 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b0db4-84c9-4112-8116-8d0c3e9826d6 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:47:27.444224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 561/1115] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:47:27 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 14:47:27.448647 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63147955-568a-4cda-bfc9-e1745ee9938c admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:47:27.461901 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63147955-568a-4cda-bfc9-e1745ee9938c admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:47:27.468618 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782e7f7-ee33-4240-8e82-035a5a61a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:47:27.469272 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782e7f7-ee33-4240-8e82-035a5a61a871 admin admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.469547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782e7f7-ee33-4240-8e82-035a5a61a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.469779 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782e7f7-ee33-4240-8e82-035a5a61a871 admin admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.470523 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782e7f7-ee33-4240-8e82-035a5a61a871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:47:27.471713 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: WARNING py.warnings [None req-2782e7f7-ee33-4240-8e82-035a5a61a871 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:47:27.471713 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: warnings.warn(msg) Aug 19 14:47:27.471713 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: Aug 19 14:47:27.472631 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782e7f7-ee33-4240-8e82-035a5a61a871 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:47:27.487608 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 555/1116] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 14:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:47:27.492260 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0db4-84c9-4112-8116-8d0c3e9826d6 admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:47:27.504196 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0db4-84c9-4112-8116-8d0c3e9826d6 admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:47:27.509353 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01934b2-7192-4cd4-a62d-7ec71112edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:47:27.510181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01934b2-7192-4cd4-a62d-7ec71112edb8 admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.510463 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01934b2-7192-4cd4-a62d-7ec71112edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.510735 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01934b2-7192-4cd4-a62d-7ec71112edb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.511409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01934b2-7192-4cd4-a62d-7ec71112edb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:47:27.512477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: WARNING py.warnings [None req-e01934b2-7192-4cd4-a62d-7ec71112edb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:47:27.512477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: warnings.warn(msg) Aug 19 14:47:27.512477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: Aug 19 14:47:27.513434 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01934b2-7192-4cd4-a62d-7ec71112edb8 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:47:27.528882 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 562/1117] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 14:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:47:27.533845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782e7f7-ee33-4240-8e82-035a5a61a871 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:47:27.545313 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782e7f7-ee33-4240-8e82-035a5a61a871 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:47:27.550704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8647b0-f710-4892-ae4f-6a0fec00e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:47:27.551420 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8647b0-f710-4892-ae4f-6a0fec00e3f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.551695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8647b0-f710-4892-ae4f-6a0fec00e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.551965 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8647b0-f710-4892-ae4f-6a0fec00e3f5 admin admin] PATH_INFO: `/v3/projects/4174e84ab59c43fab7aadf85f9b14601/users/aa053b3457da496fa96134a1fd524b63/roles/d4bd126c45e24b93a90052154a32972b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.569038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8647b0-f710-4892-ae4f-6a0fec00e3f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4174e84ab59c43fab7aadf85f9b14601, user_id=aa053b3457da496fa96134a1fd524b63, role_id=d4bd126c45e24b93a90052154a32972b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:47:27.570064 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: WARNING py.warnings [None req-8e8647b0-f710-4892-ae4f-6a0fec00e3f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:47:27.570064 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: warnings.warn(msg) Aug 19 14:47:27.570064 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: Aug 19 14:47:27.572068 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8647b0-f710-4892-ae4f-6a0fec00e3f5 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:47:27.592642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 556/1118] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 14:47:27 2022] PUT /identity/v3/projects/4174e84ab59c43fab7aadf85f9b14601/users/aa053b3457da496fa96134a1fd524b63/roles/d4bd126c45e24b93a90052154a32972b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 14:47:27.606911 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c875f95-1f37-4637-aa79-80f4db017c03 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.607192 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c875f95-1f37-4637-aa79-80f4db017c03 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.607499 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c875f95-1f37-4637-aa79-80f4db017c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.641622 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-9c875f95-1f37-4637-aa79-80f4db017c03 None None] MFA Rules not processed for user `aa053b3457da496fa96134a1fd524b63`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:47:27.643167 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-9c875f95-1f37-4637-aa79-80f4db017c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:47:27.720941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 563/1119] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:47:27 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:47:27.734599 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8902-1597-4fd0-a8d8-febf2f6bc005 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.734889 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8902-1597-4fd0-a8d8-febf2f6bc005 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.735171 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8902-1597-4fd0-a8d8-febf2f6bc005 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.736793 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 557/1120] 10.222.0.60 () {54 vars in 964 bytes} [Fri Aug 19 14:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:47:27.742622 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dec0-dda4-4047-8a4d-900d9e552893 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.742910 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dec0-dda4-4047-8a4d-900d9e552893 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.743207 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dec0-dda4-4047-8a4d-900d9e552893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.764127 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-1887dec0-dda4-4047-8a4d-900d9e552893 None None] MFA Rules not processed for user `8fcc9424a8984a3db449c23bb5908eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:47:27.765391 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-1887dec0-dda4-4047-8a4d-900d9e552893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:47:27.813358 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:47:27.823382 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 564/1121] 10.222.0.60 () {58 vars in 1061 bytes} [Fri Aug 19 14:47:27 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:47:27.831603 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8902-1597-4fd0-a8d8-febf2f6bc005 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:47:27.844744 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8902-1597-4fd0-a8d8-febf2f6bc005 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:47:27.848855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009adc3a-c824-46a8-b026-7f0dc5d1a7ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fcc9424a8984a3db449c23bb5908eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:47:27.849563 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adc3a-c824-46a8-b026-7f0dc5d1a7ad service cinder] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.849853 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adc3a-c824-46a8-b026-7f0dc5d1a7ad service cinder] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.850160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adc3a-c824-46a8-b026-7f0dc5d1a7ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.859671 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009adc3a-c824-46a8-b026-7f0dc5d1a7ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:47:27.861117 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009adc3a-c824-46a8-b026-7f0dc5d1a7ad service cinder] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:47:27.879691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 558/1122] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:47:27 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:47:27.929870 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302201a2-974a-41b1-9b43-decbbc9eaebd None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:27.930202 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302201a2-974a-41b1-9b43-decbbc9eaebd None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:27.930477 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302201a2-974a-41b1-9b43-decbbc9eaebd None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:27.931900 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 565/1123] 10.222.0.60 () {52 vars in 830 bytes} [Fri Aug 19 14:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:47:27.936515 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009adc3a-c824-46a8-b026-7f0dc5d1a7ad service cinder] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:47:28.013309 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009adc3a-c824-46a8-b026-7f0dc5d1a7ad service cinder] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:47:28.019189 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:47:28.019856 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:28.020132 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:28.020406 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] PATH_INFO: `/v3/users/aa053b3457da496fa96134a1fd524b63` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:28.021662 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa053b3457da496fa96134a1fd524b63)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:47:28.022756 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: WARNING py.warnings [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:47:28.022756 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: warnings.warn(msg) Aug 19 14:47:28.022756 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: Aug 19 14:47:28.023979 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:47:28.104445 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa053b3457da496fa96134a1fd524b63'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:47:28.130944 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa053b3457da496fa96134a1fd524b63'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:47:28.142205 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa053b3457da496fa96134a1fd524b63'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:47:28.142987 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa053b3457da496fa96134a1fd524b63'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:47:28.158288 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa053b3457da496fa96134a1fd524b63'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:47:28.165196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 559/1124] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Aug 19 14:47:27 2022] DELETE /identity/v3/users/aa053b3457da496fa96134a1fd524b63 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:47:28.169654 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48da1a-9978-4694-ad83-580db7686541 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:28.170226 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48da1a-9978-4694-ad83-580db7686541 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:28.170226 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48da1a-9978-4694-ad83-580db7686541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:28.194400 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-0b48da1a-9978-4694-ad83-580db7686541 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:47:28.195636 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-0b48da1a-9978-4694-ad83-580db7686541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:47:28.262004 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 566/1125] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:47:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:47:28.271943 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:47:28.273469 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:47:28.279454 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:47:28.334775 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97eae1-e420-4f70-a0e9-b8bd949966aa admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:47:28.339061 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eec878-b7fb-41d0-a5b2-854d4e77b9e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:47:28.339689 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eec878-b7fb-41d0-a5b2-854d4e77b9e4 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:28.339962 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eec878-b7fb-41d0-a5b2-854d4e77b9e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:28.340229 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eec878-b7fb-41d0-a5b2-854d4e77b9e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:28.350864 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eec878-b7fb-41d0-a5b2-854d4e77b9e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:47:28.352343 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eec878-b7fb-41d0-a5b2-854d4e77b9e4 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:47:28.362871 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 560/1126] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:47:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:47:28.765090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48da1a-9978-4694-ad83-580db7686541 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:47:28.766739 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-0b48da1a-9978-4694-ad83-580db7686541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:47:28.779979 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48da1a-9978-4694-ad83-580db7686541 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:47:28.788954 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:47:28.789744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:47:28.790063 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:47:28.790420 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] PATH_INFO: `/v3/projects/4174e84ab59c43fab7aadf85f9b14601` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:47:28.791599 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4174e84ab59c43fab7aadf85f9b14601)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:47:28.792748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: WARNING py.warnings [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:47:28.792748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: warnings.warn(msg) Aug 19 14:47:28.792748 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: Aug 19 14:47:28.793963 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:47:28.873321 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4174e84ab59c43fab7aadf85f9b14601', 'request_id': 'req-cdb4aadc-206a-4e04-8391-bd0003fe7309'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:47:28.880409 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4174e84ab59c43fab7aadf85f9b14601', 'request_id': 'req-cdb4aadc-206a-4e04-8391-bd0003fe7309'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:47:28.891952 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4174e84ab59c43fab7aadf85f9b14601', 'request_id': 'req-cdb4aadc-206a-4e04-8391-bd0003fe7309'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:47:28.921512 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] The token cache is being invalidate because project 4174e84ab59c43fab7aadf85f9b14601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99833) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 14:47:28.921798 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:47:28.924838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-cdb4aadc-206a-4e04-8391-bd0003fe7309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:47:28.924838 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 567/1127] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Aug 19 14:47:28 2022] DELETE /identity/v3/projects/4174e84ab59c43fab7aadf85f9b14601 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:47:38.358410 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=25 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:47:38.915707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:48:53.420404 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ff0a3-51e0-493c-a416-3bc6ab00b889 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:48:53.421142 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ff0a3-51e0-493c-a416-3bc6ab00b889 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:48:53.421263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ff0a3-51e0-493c-a416-3bc6ab00b889 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:48:53.423465 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 561/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:48:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:48:53.431924 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe679848-5bb1-4268-99eb-b8ac14a2424a None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:48:53.432570 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe679848-5bb1-4268-99eb-b8ac14a2424a None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:48:53.432894 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe679848-5bb1-4268-99eb-b8ac14a2424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:48:53.534624 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-fe679848-5bb1-4268-99eb-b8ac14a2424a None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:48:53.536622 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-fe679848-5bb1-4268-99eb-b8ac14a2424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:48:53.642767 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 568/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:48:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:48:53.812703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ff0a3-51e0-493c-a416-3bc6ab00b889 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:48:53.815795 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-0c5ff0a3-51e0-493c-a416-3bc6ab00b889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:48:53.918987 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ff0a3-51e0-493c-a416-3bc6ab00b889 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:48:53.924553 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35758338-2525-4e16-9300-cc972668e331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:48:53.925164 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35758338-2525-4e16-9300-cc972668e331 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:48:53.925431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35758338-2525-4e16-9300-cc972668e331 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:48:53.925695 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35758338-2525-4e16-9300-cc972668e331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:48:53.933939 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35758338-2525-4e16-9300-cc972668e331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:48:53.935560 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35758338-2525-4e16-9300-cc972668e331 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:48:53.948552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 562/1130] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:48:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:48:54.792653 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4dd0e-4886-4b8a-b6ea-bdfba421b423 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:48:54.793212 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4dd0e-4886-4b8a-b6ea-bdfba421b423 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:48:54.793212 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4dd0e-4886-4b8a-b6ea-bdfba421b423 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:48:54.794569 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 569/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:48:54.800788 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421948-dbe4-4978-abcc-035dc0640738 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:48:54.801509 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421948-dbe4-4978-abcc-035dc0640738 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:48:54.801712 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421948-dbe4-4978-abcc-035dc0640738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:48:54.828850 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-cc421948-dbe4-4978-abcc-035dc0640738 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:48:54.830719 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-cc421948-dbe4-4978-abcc-035dc0640738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:48:54.843929 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 563/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:48:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:48:55.003424 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4dd0e-4886-4b8a-b6ea-bdfba421b423 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:48:55.022675 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4dd0e-4886-4b8a-b6ea-bdfba421b423 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:48:55.028422 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a4043-fec9-48b8-a9ed-487178442cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:48:55.029012 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a4043-fec9-48b8-a9ed-487178442cee service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:48:55.029324 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a4043-fec9-48b8-a9ed-487178442cee service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:48:55.029715 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a4043-fec9-48b8-a9ed-487178442cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:48:55.038218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a4043-fec9-48b8-a9ed-487178442cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:48:55.039801 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a4043-fec9-48b8-a9ed-487178442cee service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:48:55.049364 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 570/1133] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:48:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:48:59.600389 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8bc1-8674-4169-b114-56b83a5e51df None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:48:59.600995 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8bc1-8674-4169-b114-56b83a5e51df None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:48:59.600995 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8bc1-8674-4169-b114-56b83a5e51df None None] PATH_INFO: `/v3` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:48:59.602332 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 564/1134] 10.222.0.17 () {54 vars in 925 bytes} [Fri Aug 19 14:48:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:48:59.610442 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e955d-4f68-44c3-85db-f1689249c32c None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:48:59.610908 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e955d-4f68-44c3-85db-f1689249c32c None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:48:59.611006 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e955d-4f68-44c3-85db-f1689249c32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:48:59.644895 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-2d9e955d-4f68-44c3-85db-f1689249c32c None None] MFA Rules not processed for user `6000b5f82dee4ff4abb8935efd8c39df`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:48:59.646083 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-2d9e955d-4f68-44c3-85db-f1689249c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:48:59.707357 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=100 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:48:59.718335 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 571/1135] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Aug 19 14:48:59 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:49:03.958777 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d408fe-2677-4229-8c52-0ff903dd64fd None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:03.959424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d408fe-2677-4229-8c52-0ff903dd64fd None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:03.959424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d408fe-2677-4229-8c52-0ff903dd64fd None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:03.960690 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 565/1136] 10.222.0.60 () {54 vars in 961 bytes} [Fri Aug 19 14:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:49:03.966939 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c9778-ee45-401f-966b-c6283d3e0dca None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:03.967735 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c9778-ee45-401f-966b-c6283d3e0dca None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:03.967907 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c9778-ee45-401f-966b-c6283d3e0dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:03.997990 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-795c9778-ee45-401f-966b-c6283d3e0dca None None] MFA Rules not processed for user `6000b5f82dee4ff4abb8935efd8c39df`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:49:03.999210 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-795c9778-ee45-401f-966b-c6283d3e0dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:49:04.009560 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 572/1137] 10.222.0.60 () {58 vars in 1058 bytes} [Fri Aug 19 14:49:03 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:49:04.017222 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d408fe-2677-4229-8c52-0ff903dd64fd None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:49:04.037650 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d408fe-2677-4229-8c52-0ff903dd64fd None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:49:04.046152 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b70ff1-d886-4e4f-9df4-13f87bb022a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6000b5f82dee4ff4abb8935efd8c39df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:49:04.047071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b70ff1-d886-4e4f-9df4-13f87bb022a4 service placement] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:04.047425 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b70ff1-d886-4e4f-9df4-13f87bb022a4 service placement] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:04.047760 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b70ff1-d886-4e4f-9df4-13f87bb022a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:04.057689 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b70ff1-d886-4e4f-9df4-13f87bb022a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:49:04.059300 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b70ff1-d886-4e4f-9df4-13f87bb022a4 service placement] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:49:04.069194 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 566/1138] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:49:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:49:06.317506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897cf5-665a-4101-ae13-4cceed3a9b53 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:06.318502 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897cf5-665a-4101-ae13-4cceed3a9b53 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:06.318502 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897cf5-665a-4101-ae13-4cceed3a9b53 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:06.320563 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 573/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:49:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:49:06.329556 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b1e8-a004-47a2-8506-af70f31ad84d None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:06.330343 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b1e8-a004-47a2-8506-af70f31ad84d None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:06.330497 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b1e8-a004-47a2-8506-af70f31ad84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:06.352916 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-0a20b1e8-a004-47a2-8506-af70f31ad84d None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:49:06.354218 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-0a20b1e8-a004-47a2-8506-af70f31ad84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:49:06.363945 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 567/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:49:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:49:06.533632 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35897cf5-665a-4101-ae13-4cceed3a9b53 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:49:06.555875 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35897cf5-665a-4101-ae13-4cceed3a9b53 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:49:06.563758 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09879b-afe5-48d2-8a2c-e528eda2ffd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:49:06.564607 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09879b-afe5-48d2-8a2c-e528eda2ffd6 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:06.564970 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09879b-afe5-48d2-8a2c-e528eda2ffd6 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:06.565333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09879b-afe5-48d2-8a2c-e528eda2ffd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:06.574437 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09879b-afe5-48d2-8a2c-e528eda2ffd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:49:06.575996 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09879b-afe5-48d2-8a2c-e528eda2ffd6 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:49:06.585728 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 574/1141] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:49:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:49:07.411113 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8765c3-9f54-4bf9-bac2-133372a418f1 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:07.411596 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8765c3-9f54-4bf9-bac2-133372a418f1 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:07.411596 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8765c3-9f54-4bf9-bac2-133372a418f1 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:07.413052 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 568/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 14:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:49:07.419276 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0098-1ac3-4ff9-a85d-12013ecb0a43 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:07.420043 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0098-1ac3-4ff9-a85d-12013ecb0a43 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:07.420187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0098-1ac3-4ff9-a85d-12013ecb0a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:07.450528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-759f0098-1ac3-4ff9-a85d-12013ecb0a43 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:49:07.451805 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-759f0098-1ac3-4ff9-a85d-12013ecb0a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:49:07.464040 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 575/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 14:49:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:49:07.627996 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8765c3-9f54-4bf9-bac2-133372a418f1 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:49:07.652834 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8765c3-9f54-4bf9-bac2-133372a418f1 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:49:07.664478 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05cbcf-b6d8-4253-9095-8d5de3d60902 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:49:07.665120 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05cbcf-b6d8-4253-9095-8d5de3d60902 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:07.665398 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05cbcf-b6d8-4253-9095-8d5de3d60902 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:07.665663 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05cbcf-b6d8-4253-9095-8d5de3d60902 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:07.675795 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05cbcf-b6d8-4253-9095-8d5de3d60902 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:49:07.678010 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05cbcf-b6d8-4253-9095-8d5de3d60902 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:49:07.688469 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 569/1144] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:49:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:49:11.952524 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987df46-aeab-495c-a76f-1bb3ff26a148 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:11.953152 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987df46-aeab-495c-a76f-1bb3ff26a148 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:11.953152 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987df46-aeab-495c-a76f-1bb3ff26a148 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:11.955191 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 576/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:49:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 14:49:11.960998 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa918a7f-0c39-4413-a6a2-cecd7fa4c2c2 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:11.961495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa918a7f-0c39-4413-a6a2-cecd7fa4c2c2 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:11.961495 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa918a7f-0c39-4413-a6a2-cecd7fa4c2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:11.982281 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-fa918a7f-0c39-4413-a6a2-cecd7fa4c2c2 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:49:11.983463 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-fa918a7f-0c39-4413-a6a2-cecd7fa4c2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:49:11.992906 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 570/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:49:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 14:49:12.348907 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987df46-aeab-495c-a76f-1bb3ff26a148 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:49:12.352607 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-a987df46-aeab-495c-a76f-1bb3ff26a148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:49:12.423388 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987df46-aeab-495c-a76f-1bb3ff26a148 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:49:12.427510 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330d85-5406-4a76-87d3-f5bf34478aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:49:12.428114 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330d85-5406-4a76-87d3-f5bf34478aed service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:12.428403 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330d85-5406-4a76-87d3-f5bf34478aed service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:12.428669 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330d85-5406-4a76-87d3-f5bf34478aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:12.438075 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a330d85-5406-4a76-87d3-f5bf34478aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:49:12.439517 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a330d85-5406-4a76-87d3-f5bf34478aed service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:49:12.455970 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 577/1147] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:49:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:49:14.656691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f44dd-06f7-452c-ae77-dc96e4eed866 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:14.657287 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f44dd-06f7-452c-ae77-dc96e4eed866 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:14.657287 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f44dd-06f7-452c-ae77-dc96e4eed866 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:14.659226 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 571/1148] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:49:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:49:14.669317 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad3eba-bd36-470c-ae04-d583a79a85ae None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:14.669744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad3eba-bd36-470c-ae04-d583a79a85ae None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:14.669876 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad3eba-bd36-470c-ae04-d583a79a85ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:14.695405 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-67ad3eba-bd36-470c-ae04-d583a79a85ae None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:49:14.696661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-67ad3eba-bd36-470c-ae04-d583a79a85ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:49:14.706862 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 578/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:49:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:49:15.067430 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f44dd-06f7-452c-ae77-dc96e4eed866 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:49:15.079652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f44dd-06f7-452c-ae77-dc96e4eed866 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:49:15.083442 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e010842-7660-40cb-84a9-735bd14b2422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:49:15.084108 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e010842-7660-40cb-84a9-735bd14b2422 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:15.084375 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e010842-7660-40cb-84a9-735bd14b2422 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:15.084638 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e010842-7660-40cb-84a9-735bd14b2422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:15.093855 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e010842-7660-40cb-84a9-735bd14b2422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:49:15.095344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e010842-7660-40cb-84a9-735bd14b2422 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:49:15.105338 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 572/1150] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:49:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:49:18.783960 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679499b9-fc08-4686-b904-f6a45241c002 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:18.784576 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679499b9-fc08-4686-b904-f6a45241c002 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:18.784576 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679499b9-fc08-4686-b904-f6a45241c002 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:18.785893 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 579/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:49:18.794330 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176fa34-c8e9-4090-b1c4-6deacad0fcf8 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:18.794896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176fa34-c8e9-4090-b1c4-6deacad0fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:18.794896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176fa34-c8e9-4090-b1c4-6deacad0fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:18.804451 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=67 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:49:18.819542 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-d176fa34-c8e9-4090-b1c4-6deacad0fcf8 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:49:18.820817 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-d176fa34-c8e9-4090-b1c4-6deacad0fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:49:18.829157 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 573/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:49:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:49:19.403265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679499b9-fc08-4686-b904-f6a45241c002 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:49:19.406438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-679499b9-fc08-4686-b904-f6a45241c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:49:19.486691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679499b9-fc08-4686-b904-f6a45241c002 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:49:19.491841 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e48418-24a0-4450-83ee-29bbf87a57d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fcc9424a8984a3db449c23bb5908eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:49:19.492706 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e48418-24a0-4450-83ee-29bbf87a57d0 service cinder] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:19.493081 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e48418-24a0-4450-83ee-29bbf87a57d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:19.493417 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e48418-24a0-4450-83ee-29bbf87a57d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:19.508046 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e48418-24a0-4450-83ee-29bbf87a57d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:49:19.509517 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e48418-24a0-4450-83ee-29bbf87a57d0 service cinder] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:49:19.519090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 580/1153] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:49:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:49:21.755256 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f755b-d399-4ab9-aec7-dad90c50c3d5 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:21.755830 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f755b-d399-4ab9-aec7-dad90c50c3d5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:21.755830 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f755b-d399-4ab9-aec7-dad90c50c3d5 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:21.757253 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 574/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 14:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:49:21.768516 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d30d6-efcc-45a3-aadf-78221fd1706a None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:21.769559 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d30d6-efcc-45a3-aadf-78221fd1706a None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:21.769812 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d30d6-efcc-45a3-aadf-78221fd1706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:21.798959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-e34d30d6-efcc-45a3-aadf-78221fd1706a None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:49:21.800206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-e34d30d6-efcc-45a3-aadf-78221fd1706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:49:21.809581 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 581/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 14:49:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:49:22.381393 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f755b-d399-4ab9-aec7-dad90c50c3d5 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:49:22.383382 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-fe9f755b-d399-4ab9-aec7-dad90c50c3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:49:22.398344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f755b-d399-4ab9-aec7-dad90c50c3d5 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:49:22.402436 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a76a1-cd81-4f64-ba95-35e98ee6ae93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fcc9424a8984a3db449c23bb5908eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:49:22.403059 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a76a1-cd81-4f64-ba95-35e98ee6ae93 service cinder] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:49:22.403334 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a76a1-cd81-4f64-ba95-35e98ee6ae93 service cinder] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:49:22.403600 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a76a1-cd81-4f64-ba95-35e98ee6ae93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:49:22.413474 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a76a1-cd81-4f64-ba95-35e98ee6ae93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:49:22.415139 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a76a1-cd81-4f64-ba95-35e98ee6ae93 service cinder] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:49:22.424864 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 575/1156] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:49:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:49:31.793659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=70 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:49:32.420567 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=8 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:50:36.429407 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750afe5-6b40-4d9f-a9ed-174fa1f43d71 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.430159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750afe5-6b40-4d9f-a9ed-174fa1f43d71 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.430159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750afe5-6b40-4d9f-a9ed-174fa1f43d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.434586 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb28f36-49a1-4309-b121-c4c6c508bf05 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.435109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb28f36-49a1-4309-b121-c4c6c508bf05 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.435109 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb28f36-49a1-4309-b121-c4c6c508bf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.451047 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-4750afe5-6b40-4d9f-a9ed-174fa1f43d71 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:36.452276 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-4750afe5-6b40-4d9f-a9ed-174fa1f43d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:36.455470 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-ecb28f36-49a1-4309-b121-c4c6c508bf05 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:36.456772 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-ecb28f36-49a1-4309-b121-c4c6c508bf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:36.460384 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 582/1157] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:50:36.464742 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 576/1158] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:50:36.470709 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ce33-bb5c-4fe3-881a-e4dd2cc4ece3 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.471236 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ce33-bb5c-4fe3-881a-e4dd2cc4ece3 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.471896 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ce33-bb5c-4fe3-881a-e4dd2cc4ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.474539 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7ce84-6bba-46fd-991e-ee1824079407 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.474920 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7ce84-6bba-46fd-991e-ee1824079407 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.475302 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7ce84-6bba-46fd-991e-ee1824079407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.496234 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-5da7ce33-bb5c-4fe3-881a-e4dd2cc4ece3 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:36.496491 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-2ff7ce84-6bba-46fd-991e-ee1824079407 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:36.497460 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-5da7ce33-bb5c-4fe3-881a-e4dd2cc4ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:36.497691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-2ff7ce84-6bba-46fd-991e-ee1824079407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:36.505434 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 583/1159] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:50:36.506286 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 577/1160] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 14:50:36.510206 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7ce84-6bba-46fd-991e-ee1824079407 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.510362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ce33-bb5c-4fe3-881a-e4dd2cc4ece3 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.519861 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7ce84-6bba-46fd-991e-ee1824079407 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.520048 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ce33-bb5c-4fe3-881a-e4dd2cc4ece3 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.524531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6c7a9-5c87-407d-8d13-1dea5305baf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.524822 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932dc2a-f825-443e-9186-97ca26a5ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.525166 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6c7a9-5c87-407d-8d13-1dea5305baf7 admin admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.525427 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932dc2a-f825-443e-9186-97ca26a5ffe6 admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.525544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6c7a9-5c87-407d-8d13-1dea5305baf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.525697 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932dc2a-f825-443e-9186-97ca26a5ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.525798 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6c7a9-5c87-407d-8d13-1dea5305baf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.526003 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932dc2a-f825-443e-9186-97ca26a5ffe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.526403 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6c7a9-5c87-407d-8d13-1dea5305baf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99834) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:50:36.526643 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932dc2a-f825-443e-9186-97ca26a5ffe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99833) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 14:50:36.526750 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6c7a9-5c87-407d-8d13-1dea5305baf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.526989 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932dc2a-f825-443e-9186-97ca26a5ffe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.528110 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: WARNING py.warnings [None req-4ff6c7a9-5c87-407d-8d13-1dea5305baf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:50:36.528110 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: warnings.warn(msg) Aug 19 14:50:36.528110 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: Aug 19 14:50:36.528593 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932dc2a-f825-443e-9186-97ca26a5ffe6 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.528995 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6c7a9-5c87-407d-8d13-1dea5305baf7 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.541845 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 584/1161] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Aug 19 14:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:50:36.546785 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 578/1162] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Aug 19 14:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 14:50:36.551394 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932dc2a-f825-443e-9186-97ca26a5ffe6 admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.552326 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6c7a9-5c87-407d-8d13-1dea5305baf7 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.561879 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932dc2a-f825-443e-9186-97ca26a5ffe6 admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.562992 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6c7a9-5c87-407d-8d13-1dea5305baf7 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.567223 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52985e2-90df-4d22-bd27-7692d4604072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.567831 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52985e2-90df-4d22-bd27-7692d4604072 admin admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.568100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52985e2-90df-4d22-bd27-7692d4604072 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.568208 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273b80e-185a-45b4-a91a-b897ed897ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.568382 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52985e2-90df-4d22-bd27-7692d4604072 admin admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.568789 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273b80e-185a-45b4-a91a-b897ed897ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.568962 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52985e2-90df-4d22-bd27-7692d4604072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.569096 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273b80e-185a-45b4-a91a-b897ed897ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.569288 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273b80e-185a-45b4-a91a-b897ed897ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.569960 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273b80e-185a-45b4-a91a-b897ed897ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.570117 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: WARNING py.warnings [None req-b52985e2-90df-4d22-bd27-7692d4604072 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:50:36.570117 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: warnings.warn(msg) Aug 19 14:50:36.570117 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: Aug 19 14:50:36.571277 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52985e2-90df-4d22-bd27-7692d4604072 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.571845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273b80e-185a-45b4-a91a-b897ed897ab4 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.612250 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 585/1163] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Aug 19 14:50:36 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:50:36.615896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 579/1164] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Aug 19 14:50:36 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 14:50:36.616485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52985e2-90df-4d22-bd27-7692d4604072 admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.616722 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273b80e-185a-45b4-a91a-b897ed897ab4 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.683499 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273b80e-185a-45b4-a91a-b897ed897ab4 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.686543 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52985e2-90df-4d22-bd27-7692d4604072 admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.688306 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd149-fa52-4a68-b52a-b4c63ee3171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.688948 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd149-fa52-4a68-b52a-b4c63ee3171d admin admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.689223 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd149-fa52-4a68-b52a-b4c63ee3171d admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.689490 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd149-fa52-4a68-b52a-b4c63ee3171d admin admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.690270 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd149-fa52-4a68-b52a-b4c63ee3171d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.691344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: WARNING py.warnings [None req-af9bd149-fa52-4a68-b52a-b4c63ee3171d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:50:36.691344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: warnings.warn(msg) Aug 19 14:50:36.691344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: Aug 19 14:50:36.692302 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbdb9b-b232-4e52-a43a-087ddd720505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.692492 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdb9b-b232-4e52-a43a-087ddd720505 admin admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.692898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdb9b-b232-4e52-a43a-087ddd720505 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.693101 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd149-fa52-4a68-b52a-b4c63ee3171d admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.693187 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdb9b-b232-4e52-a43a-087ddd720505 admin admin] PATH_INFO: `/v3/users` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.693658 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbdb9b-b232-4e52-a43a-087ddd720505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.695701 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbdb9b-b232-4e52-a43a-087ddd720505 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.715671 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 580/1165] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:50:36 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 14:50:36.718518 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 586/1166] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:50:36 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 14:50:36.719794 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd149-fa52-4a68-b52a-b4c63ee3171d admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.722538 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbdb9b-b232-4e52-a43a-087ddd720505 admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.730273 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd149-fa52-4a68-b52a-b4c63ee3171d admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.733167 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbdb9b-b232-4e52-a43a-087ddd720505 admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.735599 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcb811-db41-4158-bbcb-5af69dcaf1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.736247 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcb811-db41-4158-bbcb-5af69dcaf1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.736837 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcb811-db41-4158-bbcb-5af69dcaf1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.736837 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcb811-db41-4158-bbcb-5af69dcaf1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.737492 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcb811-db41-4158-bbcb-5af69dcaf1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.738706 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dc9bb-d494-4cff-8954-f00e79347fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.739216 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcb811-db41-4158-bbcb-5af69dcaf1d8 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.739330 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dc9bb-d494-4cff-8954-f00e79347fac admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.739575 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dc9bb-d494-4cff-8954-f00e79347fac admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.739837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dc9bb-d494-4cff-8954-f00e79347fac admin admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.740557 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dc9bb-d494-4cff-8954-f00e79347fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.742129 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dc9bb-d494-4cff-8954-f00e79347fac admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.750293 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 581/1167] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 14:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 14:50:36.754642 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcb811-db41-4158-bbcb-5af69dcaf1d8 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.755038 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 587/1168] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 14:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 14:50:36.757392 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dc9bb-d494-4cff-8954-f00e79347fac admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.765023 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcb811-db41-4158-bbcb-5af69dcaf1d8 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.766929 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dc9bb-d494-4cff-8954-f00e79347fac admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.769657 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdefac-4da1-4c5b-a851-7c10e852e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.770289 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdefac-4da1-4c5b-a851-7c10e852e4fa admin admin] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.770565 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdefac-4da1-4c5b-a851-7c10e852e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.770832 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdefac-4da1-4c5b-a851-7c10e852e4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.771422 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a247d-035c-4103-83cc-6116d3b4c215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.771551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdefac-4da1-4c5b-a851-7c10e852e4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.772010 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a247d-035c-4103-83cc-6116d3b4c215 admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.772283 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a247d-035c-4103-83cc-6116d3b4c215 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.772548 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a247d-035c-4103-83cc-6116d3b4c215 admin admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.773079 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdefac-4da1-4c5b-a851-7c10e852e4fa admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.773207 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a247d-035c-4103-83cc-6116d3b4c215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.774810 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a247d-035c-4103-83cc-6116d3b4c215 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.784997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 582/1169] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 14:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:50:36.786252 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 588/1170] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 14:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 14:50:36.789500 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdefac-4da1-4c5b-a851-7c10e852e4fa admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.790203 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a247d-035c-4103-83cc-6116d3b4c215 admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.799434 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdefac-4da1-4c5b-a851-7c10e852e4fa admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.800143 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a247d-035c-4103-83cc-6116d3b4c215 admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:36.804030 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6824f-9545-4896-9b77-18ce1a9d77ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.804676 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6824f-9545-4896-9b77-18ce1a9d77ef admin admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.804840 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3e59c-9b33-4e43-a2b1-f029127f3f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:36.804948 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6824f-9545-4896-9b77-18ce1a9d77ef admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.805197 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6824f-9545-4896-9b77-18ce1a9d77ef admin admin] PATH_INFO: `/v3/projects/f14dc5a98d9d4e2b97bbeb9fa857f760/users/7f039b1bc13b4c8ea8bdf95846a1527e/roles/d4bd126c45e24b93a90052154a32972b` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.805493 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e59c-9b33-4e43-a2b1-f029127f3f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.805766 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e59c-9b33-4e43-a2b1-f029127f3f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.806069 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e59c-9b33-4e43-a2b1-f029127f3f61 admin admin] PATH_INFO: `/v3/projects/6b817056a86a4c00a574546324c51ed3/users/7f9df8d2ba0445c5b9552c0ca0aa590b/roles/d4bd126c45e24b93a90052154a32972b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.820851 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6824f-9545-4896-9b77-18ce1a9d77ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14dc5a98d9d4e2b97bbeb9fa857f760, user_id=7f039b1bc13b4c8ea8bdf95846a1527e, role_id=d4bd126c45e24b93a90052154a32972b)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.822092 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3e59c-9b33-4e43-a2b1-f029127f3f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b817056a86a4c00a574546324c51ed3, user_id=7f9df8d2ba0445c5b9552c0ca0aa590b, role_id=d4bd126c45e24b93a90052154a32972b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:36.823156 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: WARNING py.warnings [None req-c7d3e59c-9b33-4e43-a2b1-f029127f3f61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:50:36.823156 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: warnings.warn(msg) Aug 19 14:50:36.823156 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: Aug 19 14:50:36.823544 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6824f-9545-4896-9b77-18ce1a9d77ef admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.825145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3e59c-9b33-4e43-a2b1-f029127f3f61 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:36.838789 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 583/1171] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 14:50:36 2022] PUT /identity/v3/projects/f14dc5a98d9d4e2b97bbeb9fa857f760/users/7f039b1bc13b4c8ea8bdf95846a1527e/roles/d4bd126c45e24b93a90052154a32972b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:50:36.840237 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 589/1172] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 14:50:36 2022] PUT /identity/v3/projects/6b817056a86a4c00a574546324c51ed3/users/7f9df8d2ba0445c5b9552c0ca0aa590b/roles/d4bd126c45e24b93a90052154a32972b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 14:50:36.845380 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e581-61b1-4548-93ed-08e8bcd1d4be None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.845660 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e581-61b1-4548-93ed-08e8bcd1d4be None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.845778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd100-a577-4366-a57d-c8c420c1e9a4 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:36.845940 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e581-61b1-4548-93ed-08e8bcd1d4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.846106 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd100-a577-4366-a57d-c8c420c1e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:36.846368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd100-a577-4366-a57d-c8c420c1e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:36.865520 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-7728e581-61b1-4548-93ed-08e8bcd1d4be None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:36.866793 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-7728e581-61b1-4548-93ed-08e8bcd1d4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:36.867368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-eebfd100-a577-4366-a57d-c8c420c1e9a4 None None] MFA Rules not processed for user `27969228664649ed9665cfa9861d3064`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:36.868529 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-eebfd100-a577-4366-a57d-c8c420c1e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:36.911876 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:50:36.912588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:50:36.931342 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 584/1173] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:50:36.935090 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 590/1174] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 14:50:36.945493 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e581-61b1-4548-93ed-08e8bcd1d4be None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.945668 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfd100-a577-4366-a57d-c8c420c1e9a4 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:36.947179 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-eebfd100-a577-4366-a57d-c8c420c1e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:37.010864 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e581-61b1-4548-93ed-08e8bcd1d4be None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:37.014724 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fab4e-9971-4900-89e4-bee93803c86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:37.015344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fab4e-9971-4900-89e4-bee93803c86d service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:37.015617 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fab4e-9971-4900-89e4-bee93803c86d service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:37.015884 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fab4e-9971-4900-89e4-bee93803c86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:37.024619 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfd100-a577-4366-a57d-c8c420c1e9a4 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:37.025154 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fab4e-9971-4900-89e4-bee93803c86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:37.026778 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fab4e-9971-4900-89e4-bee93803c86d service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:37.028795 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ebe9d-1c91-4c54-8279-814f8c823ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:37.029415 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ebe9d-1c91-4c54-8279-814f8c823ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:37.029691 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ebe9d-1c91-4c54-8279-814f8c823ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:37.029990 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ebe9d-1c91-4c54-8279-814f8c823ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:37.036699 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 585/1175] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:50:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:50:37.039324 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ebe9d-1c91-4c54-8279-814f8c823ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:37.040788 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ebe9d-1c91-4c54-8279-814f8c823ac1 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:37.051166 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 591/1176] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:50:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:50:42.604364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738dc8f-8649-438a-b65b-788752b7c1b4 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:42.605138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738dc8f-8649-438a-b65b-788752b7c1b4 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:42.605138 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738dc8f-8649-438a-b65b-788752b7c1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:42.667841 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-7738dc8f-8649-438a-b65b-788752b7c1b4 None None] MFA Rules not processed for user `7f039b1bc13b4c8ea8bdf95846a1527e`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:42.669200 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-7738dc8f-8649-438a-b65b-788752b7c1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:42.805560 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 586/1177] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:42 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:50:42.809549 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ebe9d-1c91-4c54-8279-814f8c823ac1 service neutron] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:42.829204 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ebe9d-1c91-4c54-8279-814f8c823ac1 service neutron] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:42.844908 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60684c46-fd52-47c6-9cd0-452dd5d439ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:42.846606 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60684c46-fd52-47c6-9cd0-452dd5d439ae admin admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:42.846890 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60684c46-fd52-47c6-9cd0-452dd5d439ae admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:42.847163 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60684c46-fd52-47c6-9cd0-452dd5d439ae admin admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:42.847821 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60684c46-fd52-47c6-9cd0-452dd5d439ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:42.850117 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60684c46-fd52-47c6-9cd0-452dd5d439ae admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:42.901375 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 592/1178] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Aug 19 14:50:42 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:50:42.906024 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738dc8f-8649-438a-b65b-788752b7c1b4 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:42.919442 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738dc8f-8649-438a-b65b-788752b7c1b4 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:42.993342 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c11e-c36e-4655-902b-40c9637645a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:42.994470 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c11e-c36e-4655-902b-40c9637645a9 admin admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:42.994766 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c11e-c36e-4655-902b-40c9637645a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:42.995045 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c11e-c36e-4655-902b-40c9637645a9 admin admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:42.995779 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7c11e-c36e-4655-902b-40c9637645a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:42.999775 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7c11e-c36e-4655-902b-40c9637645a9 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:43.028777 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 587/1179] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:50:42 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:50:43.033986 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60684c46-fd52-47c6-9cd0-452dd5d439ae admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:43.055746 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60684c46-fd52-47c6-9cd0-452dd5d439ae admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:43.080972 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7627e0e-ac3b-425e-9b3a-8de71a4b952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:43.088890 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627e0e-ac3b-425e-9b3a-8de71a4b952f admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:43.090317 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627e0e-ac3b-425e-9b3a-8de71a4b952f admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:43.091045 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627e0e-ac3b-425e-9b3a-8de71a4b952f admin admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:43.091998 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7627e0e-ac3b-425e-9b3a-8de71a4b952f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:43.094661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7627e0e-ac3b-425e-9b3a-8de71a4b952f admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:43.113972 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 593/1180] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 14:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:50:43.117837 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c11e-c36e-4655-902b-40c9637645a9 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:43.131913 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c11e-c36e-4655-902b-40c9637645a9 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:43.140029 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ad167-57fc-4e3d-b87f-67e9cade41ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:43.142599 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad167-57fc-4e3d-b87f-67e9cade41ce admin admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:43.143130 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad167-57fc-4e3d-b87f-67e9cade41ce admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:43.144263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad167-57fc-4e3d-b87f-67e9cade41ce admin admin] PATH_INFO: `/v3/projects/60be6e388ce842a0833ae9a4c6c87862/users/7ff4bf369bd7474d88e51325c1be5afa/roles/d444334199c640a7af820f46e283d49d` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:43.150867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:50:43.192038 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ad167-57fc-4e3d-b87f-67e9cade41ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=60be6e388ce842a0833ae9a4c6c87862, user_id=7ff4bf369bd7474d88e51325c1be5afa, role_id=d444334199c640a7af820f46e283d49d)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:43.195340 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ad167-57fc-4e3d-b87f-67e9cade41ce admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:43.219715 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 588/1181] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 14:50:43 2022] PUT /identity/v3/projects/60be6e388ce842a0833ae9a4c6c87862/users/7ff4bf369bd7474d88e51325c1be5afa/roles/d444334199c640a7af820f46e283d49d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 14:50:43.223864 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7627e0e-ac3b-425e-9b3a-8de71a4b952f admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:43.254891 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7627e0e-ac3b-425e-9b3a-8de71a4b952f admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:43.374261 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e7771-5e88-4d30-8987-e61079736367 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:43.374973 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e7771-5e88-4d30-8987-e61079736367 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:43.375224 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e7771-5e88-4d30-8987-e61079736367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:43.394892 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcada6-080d-4718-89a5-e3eca602169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:43.396920 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcada6-080d-4718-89a5-e3eca602169a admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:43.397292 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcada6-080d-4718-89a5-e3eca602169a admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:43.397634 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcada6-080d-4718-89a5-e3eca602169a admin admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:43.398401 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcada6-080d-4718-89a5-e3eca602169a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:43.400432 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcada6-080d-4718-89a5-e3eca602169a admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:43.416612 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 594/1182] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 14:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:50:43.420893 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcada6-080d-4718-89a5-e3eca602169a admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:43.432383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcada6-080d-4718-89a5-e3eca602169a admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:43.441809 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700c5a0-a8dc-4d28-bd05-adf63156b228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:43.442898 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c5a0-a8dc-4d28-bd05-adf63156b228 admin admin] REQUEST_METHOD: `PUT` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:43.443393 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c5a0-a8dc-4d28-bd05-adf63156b228 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:43.443891 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c5a0-a8dc-4d28-bd05-adf63156b228 admin admin] PATH_INFO: `/v3/projects/60be6e388ce842a0833ae9a4c6c87862/users/7ff4bf369bd7474d88e51325c1be5afa/roles/d444334199c640a7af820f46e283d49d` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:43.446313 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700c5a0-a8dc-4d28-bd05-adf63156b228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60be6e388ce842a0833ae9a4c6c87862, user_id=7ff4bf369bd7474d88e51325c1be5afa, role_id=d444334199c640a7af820f46e283d49d)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:43.449784 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-8e9e7771-5e88-4d30-8987-e61079736367 None None] MFA Rules not processed for user `7f9df8d2ba0445c5b9552c0ca0aa590b`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:43.450134 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700c5a0-a8dc-4d28-bd05-adf63156b228 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:43.451121 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-8e9e7771-5e88-4d30-8987-e61079736367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:43.484333 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 595/1183] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 14:50:43 2022] PUT /identity/v3/projects/60be6e388ce842a0833ae9a4c6c87862/users/7ff4bf369bd7474d88e51325c1be5afa/roles/d444334199c640a7af820f46e283d49d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 14:50:43.571912 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 589/1184] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:43 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:50:43.574644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700c5a0-a8dc-4d28-bd05-adf63156b228 admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:43.635880 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:50:43.688051 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700c5a0-a8dc-4d28-bd05-adf63156b228 admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:43.694006 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c334de-41f4-4ca7-9765-e3414b29f4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:43.694695 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c334de-41f4-4ca7-9765-e3414b29f4bc admin admin] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:43.694977 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c334de-41f4-4ca7-9765-e3414b29f4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:43.695342 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c334de-41f4-4ca7-9765-e3414b29f4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:43.696058 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c334de-41f4-4ca7-9765-e3414b29f4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:43.698322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c334de-41f4-4ca7-9765-e3414b29f4bc admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:43.738157 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 596/1185] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Aug 19 14:50:43 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 14:50:43.742196 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e7771-5e88-4d30-8987-e61079736367 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:43.757951 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e7771-5e88-4d30-8987-e61079736367 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:43.851889 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047042dc-b391-4594-a050-6dd63b3dd156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:43.852599 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047042dc-b391-4594-a050-6dd63b3dd156 admin admin] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:43.852928 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047042dc-b391-4594-a050-6dd63b3dd156 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:43.853258 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047042dc-b391-4594-a050-6dd63b3dd156 admin admin] PATH_INFO: `/v3/users` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:43.854004 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047042dc-b391-4594-a050-6dd63b3dd156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:43.858247 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047042dc-b391-4594-a050-6dd63b3dd156 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:43.892792 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 590/1186] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Aug 19 14:50:43 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 14:50:43.897849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c334de-41f4-4ca7-9765-e3414b29f4bc admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:43.927957 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c334de-41f4-4ca7-9765-e3414b29f4bc admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:43.941224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008d39b-165d-4ee0-8677-2c0b5f61405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:43.942507 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008d39b-165d-4ee0-8677-2c0b5f61405d admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:43.942947 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008d39b-165d-4ee0-8677-2c0b5f61405d admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:43.943368 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008d39b-165d-4ee0-8677-2c0b5f61405d admin admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:43.944707 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008d39b-165d-4ee0-8677-2c0b5f61405d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:43.949960 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008d39b-165d-4ee0-8677-2c0b5f61405d admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:43.973713 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 597/1187] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 14:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 14:50:43.978730 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047042dc-b391-4594-a050-6dd63b3dd156 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:43.993503 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047042dc-b391-4594-a050-6dd63b3dd156 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:44.002522 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd01fc-2048-4bd4-8af8-1129dc056da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:44.003227 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd01fc-2048-4bd4-8af8-1129dc056da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:44.006182 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd01fc-2048-4bd4-8af8-1129dc056da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:44.006630 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd01fc-2048-4bd4-8af8-1129dc056da6 admin admin] PATH_INFO: `/v3/projects/b94b690c2cb4425ea2fb798db0bd45f9/users/de6939be9bc848b58b7273d6600a183b/roles/d444334199c640a7af820f46e283d49d` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:44.029812 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd01fc-2048-4bd4-8af8-1129dc056da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94b690c2cb4425ea2fb798db0bd45f9, user_id=de6939be9bc848b58b7273d6600a183b, role_id=d444334199c640a7af820f46e283d49d)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:44.033266 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd01fc-2048-4bd4-8af8-1129dc056da6 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:44.060836 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 591/1188] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 14:50:43 2022] PUT /identity/v3/projects/b94b690c2cb4425ea2fb798db0bd45f9/users/de6939be9bc848b58b7273d6600a183b/roles/d444334199c640a7af820f46e283d49d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 14:50:44.065099 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008d39b-165d-4ee0-8677-2c0b5f61405d admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:44.078956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008d39b-165d-4ee0-8677-2c0b5f61405d admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:44.160853 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcb3f4-8131-4a7d-87d9-2b972bb85294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:44.161383 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb3f4-8131-4a7d-87d9-2b972bb85294 admin admin] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:44.161659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb3f4-8131-4a7d-87d9-2b972bb85294 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:44.161951 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb3f4-8131-4a7d-87d9-2b972bb85294 admin admin] PATH_INFO: `/v3/roles` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:44.162642 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcb3f4-8131-4a7d-87d9-2b972bb85294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:44.164308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcb3f4-8131-4a7d-87d9-2b972bb85294 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:44.190239 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 598/1189] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Aug 19 14:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 14:50:44.191177 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd01fc-2048-4bd4-8af8-1129dc056da6 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:44.204302 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd01fc-2048-4bd4-8af8-1129dc056da6 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:44.214762 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f1a9b-9b01-4fab-b50f-59d6e1a542c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:44.215808 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f1a9b-9b01-4fab-b50f-59d6e1a542c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:44.216078 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f1a9b-9b01-4fab-b50f-59d6e1a542c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:44.216342 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f1a9b-9b01-4fab-b50f-59d6e1a542c9 admin admin] PATH_INFO: `/v3/projects/b94b690c2cb4425ea2fb798db0bd45f9/users/de6939be9bc848b58b7273d6600a183b/roles/d444334199c640a7af820f46e283d49d` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:44.219930 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f1a9b-9b01-4fab-b50f-59d6e1a542c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94b690c2cb4425ea2fb798db0bd45f9, user_id=de6939be9bc848b58b7273d6600a183b, role_id=d444334199c640a7af820f46e283d49d)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:44.222706 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f1a9b-9b01-4fab-b50f-59d6e1a542c9 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:44.234777 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 592/1190] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Aug 19 14:50:44 2022] PUT /identity/v3/projects/b94b690c2cb4425ea2fb798db0bd45f9/users/de6939be9bc848b58b7273d6600a183b/roles/d444334199c640a7af820f46e283d49d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 14:50:50.214442 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2f786-1736-46bb-b5f2-d44547eda9a6 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:50.215077 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2f786-1736-46bb-b5f2-d44547eda9a6 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:50.215468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2f786-1736-46bb-b5f2-d44547eda9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:50.275162 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-f7b2f786-1736-46bb-b5f2-d44547eda9a6 None None] MFA Rules not processed for user `7ff4bf369bd7474d88e51325c1be5afa`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:50.276811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-f7b2f786-1736-46bb-b5f2-d44547eda9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:50.389684 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 599/1191] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:50 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:50:50.405860 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f1a9b-9b01-4fab-b50f-59d6e1a542c9 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:50.408052 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-2f7f1a9b-9b01-4fab-b50f-59d6e1a542c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:50.444597 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:50:50.494070 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f1a9b-9b01-4fab-b50f-59d6e1a542c9 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:50.498153 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fc49b-66ab-4bdd-9a1e-eed1bd0abce2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e541d55268064ad986a5d05108120f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:50.498770 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc49b-66ab-4bdd-9a1e-eed1bd0abce2 service glance] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:50.499224 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc49b-66ab-4bdd-9a1e-eed1bd0abce2 service glance] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:50.499341 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc49b-66ab-4bdd-9a1e-eed1bd0abce2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:50.573125 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fc49b-66ab-4bdd-9a1e-eed1bd0abce2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:50.575281 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fc49b-66ab-4bdd-9a1e-eed1bd0abce2 service glance] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:50.588629 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 593/1192] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:50:50 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:50:51.427136 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052734-2073-44e1-b925-00f79c288df2 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:51.427974 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052734-2073-44e1-b925-00f79c288df2 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:51.428406 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052734-2073-44e1-b925-00f79c288df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:51.497627 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-cb052734-2073-44e1-b925-00f79c288df2 None None] MFA Rules not processed for user `de6939be9bc848b58b7273d6600a183b`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:51.499441 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-cb052734-2073-44e1-b925-00f79c288df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:51.518340 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:50:51.611647 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 600/1193] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:51 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 14:50:51.624669 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fc49b-66ab-4bdd-9a1e-eed1bd0abce2 service glance] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:50:51.633341 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fc49b-66ab-4bdd-9a1e-eed1bd0abce2 service glance] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:50:51.637523 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22b802-a899-44d9-993f-5fc70e943ecf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e541d55268064ad986a5d05108120f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:50:51.638160 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22b802-a899-44d9-993f-5fc70e943ecf service glance] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:51.638449 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22b802-a899-44d9-993f-5fc70e943ecf service glance] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:51.638701 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22b802-a899-44d9-993f-5fc70e943ecf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:51.726559 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22b802-a899-44d9-993f-5fc70e943ecf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:50:51.728364 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22b802-a899-44d9-993f-5fc70e943ecf service glance] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:50:51.741561 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 594/1194] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:50:51 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:50:59.713503 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f9b4f-f959-47a9-8c67-88df2ef179fb None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:50:59.714181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f9b4f-f959-47a9-8c67-88df2ef179fb None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:50:59.714181 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f9b4f-f959-47a9-8c67-88df2ef179fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:50:59.735231 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-f40f9b4f-f959-47a9-8c67-88df2ef179fb None None] MFA Rules not processed for user `7f9df8d2ba0445c5b9552c0ca0aa590b`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:50:59.736531 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-f40f9b4f-f959-47a9-8c67-88df2ef179fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:50:59.744199 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 601/1195] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:50:59 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:00.054337 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e576f38-ede7-44d8-8842-3f2545b68b40 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:00.055451 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e576f38-ede7-44d8-8842-3f2545b68b40 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:00.056108 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e576f38-ede7-44d8-8842-3f2545b68b40 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:00.057554 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 595/1196] 10.222.0.60 () {54 vars in 962 bytes} [Fri Aug 19 14:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:51:00.076548 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51311-87c5-4802-a341-833d6d7c1e32 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:00.076829 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51311-87c5-4802-a341-833d6d7c1e32 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:00.077095 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51311-87c5-4802-a341-833d6d7c1e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:00.118233 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-36c51311-87c5-4802-a341-833d6d7c1e32 None None] MFA Rules not processed for user `c1a9ed9280d249f9a76d037ff8407082`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:00.119442 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-36c51311-87c5-4802-a341-833d6d7c1e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:00.217870 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 602/1197] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Aug 19 14:51:00 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:00.223434 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06de21-86f0-4655-98a8-5264813ebdb8 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:00.224219 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06de21-86f0-4655-98a8-5264813ebdb8 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:00.224915 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06de21-86f0-4655-98a8-5264813ebdb8 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:00.226551 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 596/1198] 10.222.0.60 () {54 vars in 912 bytes} [Fri Aug 19 14:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:51:00.233282 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cdaa9-2709-46fb-b157-cf86c5bcda8c None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:00.234322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cdaa9-2709-46fb-b157-cf86c5bcda8c None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:00.234468 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cdaa9-2709-46fb-b157-cf86c5bcda8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:00.258202 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-ee7cdaa9-2709-46fb-b157-cf86c5bcda8c None None] MFA Rules not processed for user `c1a9ed9280d249f9a76d037ff8407082`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:00.259497 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-ee7cdaa9-2709-46fb-b157-cf86c5bcda8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:00.270506 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 603/1199] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Aug 19 14:51:00 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:00.285472 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06de21-86f0-4655-98a8-5264813ebdb8 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:51:00.287534 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-2d06de21-86f0-4655-98a8-5264813ebdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:00.305767 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06de21-86f0-4655-98a8-5264813ebdb8 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:51:00.310428 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea7c3a-7f01-42d4-80a6-4b339547fd11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e541d55268064ad986a5d05108120f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:51:00.311113 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea7c3a-7f01-42d4-80a6-4b339547fd11 service glance] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:00.311579 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea7c3a-7f01-42d4-80a6-4b339547fd11 service glance] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:00.311852 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea7c3a-7f01-42d4-80a6-4b339547fd11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:00.324467 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea7c3a-7f01-42d4-80a6-4b339547fd11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:51:00.325451 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea7c3a-7f01-42d4-80a6-4b339547fd11 service glance] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:51:00.337950 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 597/1200] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:51:00 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:51:00.723063 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd5f6-70ac-49ba-a9b5-c790041545b9 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:00.723614 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd5f6-70ac-49ba-a9b5-c790041545b9 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:00.723733 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd5f6-70ac-49ba-a9b5-c790041545b9 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:00.725188 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 604/1201] 10.222.0.60 () {54 vars in 912 bytes} [Fri Aug 19 14:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:51:00.731387 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33c51f-b924-4f6f-927b-74653914da00 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:00.731867 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33c51f-b924-4f6f-927b-74653914da00 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:00.732351 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33c51f-b924-4f6f-927b-74653914da00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:00.766589 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-bc33c51f-b924-4f6f-927b-74653914da00 None None] MFA Rules not processed for user `ff8273f4715e4f8ca50106a9abf7781b`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:00.768000 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-bc33c51f-b924-4f6f-927b-74653914da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:00.850895 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 598/1202] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Aug 19 14:51:00 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:00.864600 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd5f6-70ac-49ba-a9b5-c790041545b9 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:51:00.880802 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd5f6-70ac-49ba-a9b5-c790041545b9 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:51:00.885659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c766d-8648-4d7d-9212-e8f7cf8e4706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:51:00.886959 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c766d-8648-4d7d-9212-e8f7cf8e4706 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:00.887464 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c766d-8648-4d7d-9212-e8f7cf8e4706 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:00.887837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c766d-8648-4d7d-9212-e8f7cf8e4706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:00.896346 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c766d-8648-4d7d-9212-e8f7cf8e4706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:51:00.898355 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c766d-8648-4d7d-9212-e8f7cf8e4706 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:51:00.908736 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 605/1203] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:51:00 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 14:51:01.365022 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8fa51-1377-42cf-bcb6-ce164388e423 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:01.365553 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8fa51-1377-42cf-bcb6-ce164388e423 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:01.365803 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8fa51-1377-42cf-bcb6-ce164388e423 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:01.367613 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 599/1204] 10.222.0.60 () {54 vars in 962 bytes} [Fri Aug 19 14:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:51:01.379196 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aedc5-c056-4d7f-90cc-008b24dca321 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:01.379485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aedc5-c056-4d7f-90cc-008b24dca321 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:01.381092 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ebf36-7274-424f-984e-e920fc56bd99 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:01.381547 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ebf36-7274-424f-984e-e920fc56bd99 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:01.381657 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ebf36-7274-424f-984e-e920fc56bd99 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:01.383119 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 600/1205] 10.222.0.60 () {54 vars in 961 bytes} [Fri Aug 19 14:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:51:01.387185 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aedc5-c056-4d7f-90cc-008b24dca321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:01.390331 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad625f82-1c37-4131-b8bb-4aa92e3c6227 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:01.390798 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad625f82-1c37-4131-b8bb-4aa92e3c6227 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:01.391241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad625f82-1c37-4131-b8bb-4aa92e3c6227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:01.403769 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=100 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:51:01.418507 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-ad625f82-1c37-4131-b8bb-4aa92e3c6227 None None] MFA Rules not processed for user `6000b5f82dee4ff4abb8935efd8c39df`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:01.419226 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-466aedc5-c056-4d7f-90cc-008b24dca321 None None] MFA Rules not processed for user `c1a9ed9280d249f9a76d037ff8407082`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:01.420233 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-ad625f82-1c37-4131-b8bb-4aa92e3c6227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:01.420849 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-466aedc5-c056-4d7f-90cc-008b24dca321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:01.433055 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 606/1206] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Aug 19 14:51:01 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:01.440659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2cae-c2d6-4eb0-a596-1e5df5f51f53 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:01.440956 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2cae-c2d6-4eb0-a596-1e5df5f51f53 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:01.441222 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2cae-c2d6-4eb0-a596-1e5df5f51f53 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:01.443101 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 607/1207] 10.222.0.60 () {54 vars in 912 bytes} [Fri Aug 19 14:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:51:01.450880 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e6007-9bc6-4ed7-b77f-f1cd82e55c87 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:01.451124 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e6007-9bc6-4ed7-b77f-f1cd82e55c87 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:01.451403 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e6007-9bc6-4ed7-b77f-f1cd82e55c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:01.476201 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-aa3e6007-9bc6-4ed7-b77f-f1cd82e55c87 None None] MFA Rules not processed for user `c1a9ed9280d249f9a76d037ff8407082`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:01.477819 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-aa3e6007-9bc6-4ed7-b77f-f1cd82e55c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:01.495145 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 608/1208] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Aug 19 14:51:01 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:01.510345 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e6007-9bc6-4ed7-b77f-f1cd82e55c87 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:51:01.521612 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 601/1209] 10.222.0.60 () {58 vars in 1058 bytes} [Fri Aug 19 14:51:01 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 19 14:51:01.525339 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e6007-9bc6-4ed7-b77f-f1cd82e55c87 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:51:01.528840 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad625f82-1c37-4131-b8bb-4aa92e3c6227 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:51:01.532586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9489db0-f7c6-4c4a-ba0e-6f79e97cd0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:51:01.533631 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9489db0-f7c6-4c4a-ba0e-6f79e97cd0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:01.533933 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9489db0-f7c6-4c4a-ba0e-6f79e97cd0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:01.534214 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9489db0-f7c6-4c4a-ba0e-6f79e97cd0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:01.540907 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad625f82-1c37-4131-b8bb-4aa92e3c6227 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:51:01.548165 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75dc52-cb46-4be4-9c1e-37f706bd3868 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6000b5f82dee4ff4abb8935efd8c39df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:51:01.548858 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75dc52-cb46-4be4-9c1e-37f706bd3868 service placement] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:01.549136 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75dc52-cb46-4be4-9c1e-37f706bd3868 service placement] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:01.549399 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75dc52-cb46-4be4-9c1e-37f706bd3868 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:01.550218 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9489db0-f7c6-4c4a-ba0e-6f79e97cd0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:51:01.551243 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-9b75dc52-cb46-4be4-9c1e-37f706bd3868 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:01.551717 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9489db0-f7c6-4c4a-ba0e-6f79e97cd0a6 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:51:01.567438 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 609/1210] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:51:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 14:51:01.567863 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75dc52-cb46-4be4-9c1e-37f706bd3868 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:51:01.570263 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75dc52-cb46-4be4-9c1e-37f706bd3868 service placement] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:51:01.582847 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 602/1211] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:51:01 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 14:51:10.979874 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2017-6261-4494-85a7-2e58e8a95e89 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:10.980617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2017-6261-4494-85a7-2e58e8a95e89 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:10.980617 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2017-6261-4494-85a7-2e58e8a95e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:11.002014 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-a52a2017-6261-4494-85a7-2e58e8a95e89 None None] MFA Rules not processed for user `ff8273f4715e4f8ca50106a9abf7781b`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:11.003225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-a52a2017-6261-4494-85a7-2e58e8a95e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:11.009885 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 610/1212] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Aug 19 14:51:10 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:11.022492 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75dc52-cb46-4be4-9c1e-37f706bd3868 service placement] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:51:11.031707 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75dc52-cb46-4be4-9c1e-37f706bd3868 service placement] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:51:11.035399 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af05e1-726a-4644-8c82-2b6a163a2b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:51:11.036030 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af05e1-726a-4644-8c82-2b6a163a2b57 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:11.036303 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af05e1-726a-4644-8c82-2b6a163a2b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:11.036567 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af05e1-726a-4644-8c82-2b6a163a2b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:11.044026 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af05e1-726a-4644-8c82-2b6a163a2b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:51:11.045502 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af05e1-726a-4644-8c82-2b6a163a2b57 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:51:11.053769 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 603/1213] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:51:11 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:51:11.761775 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a6bc-f352-4a84-9609-edded17cd202 None None] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:11.762124 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a6bc-f352-4a84-9609-edded17cd202 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:11.762336 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a6bc-f352-4a84-9609-edded17cd202 None None] PATH_INFO: `/` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:11.763677 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 611/1214] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 14:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:51:11.813257 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16931e-ada4-4bd8-9de5-76039ac77a2e None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:11.813525 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16931e-ada4-4bd8-9de5-76039ac77a2e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:11.813801 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16931e-ada4-4bd8-9de5-76039ac77a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:11.836307 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-ec16931e-ada4-4bd8-9de5-76039ac77a2e None None] MFA Rules not processed for user `c1a9ed9280d249f9a76d037ff8407082`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:11.837586 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-ec16931e-ada4-4bd8-9de5-76039ac77a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:11.849222 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 604/1215] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 14:51:11 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:11.871973 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178a6bc-f352-4a84-9609-edded17cd202 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:51:11.891254 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178a6bc-f352-4a84-9609-edded17cd202 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:51:11.898204 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62224724-728c-4650-9d03-3df1def8dd56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:51:11.899008 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224724-728c-4650-9d03-3df1def8dd56 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:11.899189 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224724-728c-4650-9d03-3df1def8dd56 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:11.899433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224724-728c-4650-9d03-3df1def8dd56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:11.910355 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62224724-728c-4650-9d03-3df1def8dd56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:51:11.912182 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62224724-728c-4650-9d03-3df1def8dd56 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:51:11.924215 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 612/1216] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:51:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:51:17.842484 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0dba4-3362-4635-9640-a5c985c20a36 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:17.843207 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0dba4-3362-4635-9640-a5c985c20a36 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:17.843207 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0dba4-3362-4635-9640-a5c985c20a36 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:17.844846 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 605/1217] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 14:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:51:17.853502 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831cf63-da6d-4781-8a61-06753a701deb None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:17.854049 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831cf63-da6d-4781-8a61-06753a701deb None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:17.854049 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831cf63-da6d-4781-8a61-06753a701deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:17.874584 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-4831cf63-da6d-4781-8a61-06753a701deb None None] MFA Rules not processed for user `c1a9ed9280d249f9a76d037ff8407082`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:17.875807 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-4831cf63-da6d-4781-8a61-06753a701deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:17.885547 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 613/1218] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 14:51:17 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 14:51:17.900033 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0dba4-3362-4635-9640-a5c985c20a36 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:51:17.914700 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0dba4-3362-4635-9640-a5c985c20a36 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:51:17.920991 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ab3f6-6ccf-460f-b3ca-cba6c1b8b749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:51:17.921685 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ab3f6-6ccf-460f-b3ca-cba6c1b8b749 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:17.921999 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ab3f6-6ccf-460f-b3ca-cba6c1b8b749 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:17.922285 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ab3f6-6ccf-460f-b3ca-cba6c1b8b749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:17.932207 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ab3f6-6ccf-460f-b3ca-cba6c1b8b749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:51:17.934019 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ab3f6-6ccf-460f-b3ca-cba6c1b8b749 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:51:17.946926 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 606/1219] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:51:17 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:51:27.869305 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=93 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:51:27.940515 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=48 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:51:29.398910 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831cf63-da6d-4781-8a61-06753a701deb None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:51:29.410224 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831cf63-da6d-4781-8a61-06753a701deb None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:51:29.413936 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f8175-25b7-4ba2-a43b-442b9f7d1168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:51:29.414556 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f8175-25b7-4ba2-a43b-442b9f7d1168 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:29.414828 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f8175-25b7-4ba2-a43b-442b9f7d1168 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:29.415092 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f8175-25b7-4ba2-a43b-442b9f7d1168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:29.424319 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f8175-25b7-4ba2-a43b-442b9f7d1168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:51:29.425998 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f8175-25b7-4ba2-a43b-442b9f7d1168 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:51:29.435541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 614/1220] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:51:29 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:51:31.454401 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913e850-7f0d-4764-87dc-3a87dcf4941a None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:31.454980 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913e850-7f0d-4764-87dc-3a87dcf4941a None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:31.454980 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913e850-7f0d-4764-87dc-3a87dcf4941a None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:31.456426 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 607/1221] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 14:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:51:31.461949 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272a6c5-8fbb-4e0a-ad12-1253344462c9 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:31.462520 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272a6c5-8fbb-4e0a-ad12-1253344462c9 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:31.462520 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272a6c5-8fbb-4e0a-ad12-1253344462c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:31.486585 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-e272a6c5-8fbb-4e0a-ad12-1253344462c9 None None] MFA Rules not processed for user `c1a9ed9280d249f9a76d037ff8407082`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:31.488200 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-e272a6c5-8fbb-4e0a-ad12-1253344462c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:31.500488 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 615/1222] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 14:51:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:31.517354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913e850-7f0d-4764-87dc-3a87dcf4941a None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:51:31.534549 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913e850-7f0d-4764-87dc-3a87dcf4941a None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:51:31.542127 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6757ab-ab6b-4c64-95b0-e16faca0a493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:51:31.543243 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6757ab-ab6b-4c64-95b0-e16faca0a493 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:31.543742 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6757ab-ab6b-4c64-95b0-e16faca0a493 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:31.544215 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6757ab-ab6b-4c64-95b0-e16faca0a493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:31.553862 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6757ab-ab6b-4c64-95b0-e16faca0a493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:51:31.556055 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6757ab-ab6b-4c64-95b0-e16faca0a493 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:51:31.586755 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 608/1223] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:51:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:51:41.480846 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=9 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:51:41.563831 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=6 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:51:51.457329 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd1a69-2bed-4323-a025-e59a62a1a36d None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:51.458025 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd1a69-2bed-4323-a025-e59a62a1a36d None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:51.458025 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd1a69-2bed-4323-a025-e59a62a1a36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:51.482261 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-c6bd1a69-2bed-4323-a025-e59a62a1a36d None None] MFA Rules not processed for user `7f039b1bc13b4c8ea8bdf95846a1527e`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:51.483513 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-c6bd1a69-2bed-4323-a025-e59a62a1a36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:51.494223 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 616/1224] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:51:51 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:52.137583 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5600dd-e917-4ab6-a9bf-7c6192b418ba None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:52.138198 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5600dd-e917-4ab6-a9bf-7c6192b418ba None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:52.138198 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5600dd-e917-4ab6-a9bf-7c6192b418ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:52.162458 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-3e5600dd-e917-4ab6-a9bf-7c6192b418ba None None] MFA Rules not processed for user `ff8273f4715e4f8ca50106a9abf7781b`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:51:52.164427 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-3e5600dd-e917-4ab6-a9bf-7c6192b418ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:51:52.173084 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 609/1225] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Aug 19 14:51:52 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:51:52.185057 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd1a69-2bed-4323-a025-e59a62a1a36d None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:51:52.195196 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd1a69-2bed-4323-a025-e59a62a1a36d None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:51:52.200065 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ee1cf-0db9-4562-97ba-307de8f07566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:51:52.200965 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ee1cf-0db9-4562-97ba-307de8f07566 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:51:52.201353 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ee1cf-0db9-4562-97ba-307de8f07566 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:51:52.201758 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ee1cf-0db9-4562-97ba-307de8f07566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:51:52.214307 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ee1cf-0db9-4562-97ba-307de8f07566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:51:52.221847 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ee1cf-0db9-4562-97ba-307de8f07566 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:51:52.229511 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 617/1226] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:51:52 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:52:02.154493 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:52:02.223521 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=9 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:52:17.362700 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a47f-e950-4b0f-91dd-ebba08cc649e None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:52:17.363190 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a47f-e950-4b0f-91dd-ebba08cc649e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:52:17.363272 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a47f-e950-4b0f-91dd-ebba08cc649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:52:17.383369 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-a605a47f-e950-4b0f-91dd-ebba08cc649e None None] MFA Rules not processed for user `7f039b1bc13b4c8ea8bdf95846a1527e`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:52:17.384721 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-a605a47f-e950-4b0f-91dd-ebba08cc649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:52:17.392587 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 610/1227] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:52:17 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:52:27.377480 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:52:29.816610 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7df1aa-9859-463c-93bd-d014ad9138a6 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:52:29.817445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7df1aa-9859-463c-93bd-d014ad9138a6 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:52:29.817445 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7df1aa-9859-463c-93bd-d014ad9138a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:52:29.838286 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-5e7df1aa-9859-463c-93bd-d014ad9138a6 None None] MFA Rules not processed for user `7f039b1bc13b4c8ea8bdf95846a1527e`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:52:29.839517 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-5e7df1aa-9859-463c-93bd-d014ad9138a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:52:29.848238 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 618/1228] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:52:29 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:52:39.833076 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=3 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:53:27.715983 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5fde6-a7f8-4ed1-8d19-3fa0253d177e None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:53:27.716639 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5fde6-a7f8-4ed1-8d19-3fa0253d177e None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:53:27.716639 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5fde6-a7f8-4ed1-8d19-3fa0253d177e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:53:27.736589 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-24a5fde6-a7f8-4ed1-8d19-3fa0253d177e None None] MFA Rules not processed for user `7f039b1bc13b4c8ea8bdf95846a1527e`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:53:27.737780 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-24a5fde6-a7f8-4ed1-8d19-3fa0253d177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:53:27.747739 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 611/1229] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:53:27 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:53:37.731023 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:53:39.634674 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7df1aa-9859-463c-93bd-d014ad9138a6 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:53:39.655726 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7df1aa-9859-463c-93bd-d014ad9138a6 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:53:39.660079 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0846a26-b094-43ca-bb5a-ca5b6d7de0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:53:39.660688 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0846a26-b094-43ca-bb5a-ca5b6d7de0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:53:39.660960 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0846a26-b094-43ca-bb5a-ca5b6d7de0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:53:39.661225 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0846a26-b094-43ca-bb5a-ca5b6d7de0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:53:39.672993 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0846a26-b094-43ca-bb5a-ca5b6d7de0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:53:39.677089 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0846a26-b094-43ca-bb5a-ca5b6d7de0e0 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:53:39.693688 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 619/1230] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:53:39 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:53:49.688396 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=10 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:55:01.815711 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5fde6-a7f8-4ed1-8d19-3fa0253d177e None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:55:01.837682 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5fde6-a7f8-4ed1-8d19-3fa0253d177e None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:55:01.843129 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34430f-e2be-420a-9a8d-5aa29d8f86f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6000b5f82dee4ff4abb8935efd8c39df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:55:01.843730 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34430f-e2be-420a-9a8d-5aa29d8f86f8 service placement] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:55:01.843997 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34430f-e2be-420a-9a8d-5aa29d8f86f8 service placement] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:55:01.844265 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34430f-e2be-420a-9a8d-5aa29d8f86f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:55:01.852954 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34430f-e2be-420a-9a8d-5aa29d8f86f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:55:01.854639 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34430f-e2be-420a-9a8d-5aa29d8f86f8 service placement] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:55:01.864374 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 612/1231] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:55:01 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:55:11.860496 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=10 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:55:19.526943 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058ace-0670-437a-ae4e-f033a1c15e96 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:55:19.527484 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058ace-0670-437a-ae4e-f033a1c15e96 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:55:19.527484 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058ace-0670-437a-ae4e-f033a1c15e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:55:19.549491 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-3c058ace-0670-437a-ae4e-f033a1c15e96 None None] MFA Rules not processed for user `7f9df8d2ba0445c5b9552c0ca0aa590b`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:55:19.551100 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-3c058ace-0670-437a-ae4e-f033a1c15e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:55:19.559875 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 620/1232] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:55:19 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:55:29.543623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=3 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:55:50.085747 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bea8a-2313-49ea-adba-ccf7f9f0cca5 None None] REQUEST_METHOD: `POST` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:55:50.086453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bea8a-2313-49ea-adba-ccf7f9f0cca5 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:55:50.086453 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bea8a-2313-49ea-adba-ccf7f9f0cca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:55:50.107824 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.auth.core [None req-367bea8a-2313-49ea-adba-ccf7f9f0cca5 None None] MFA Rules not processed for user `7f039b1bc13b4c8ea8bdf95846a1527e`. Rule list: `[]` (Enabled: `True`). {{(pid=99834) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:55:50.109179 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-367bea8a-2313-49ea-adba-ccf7f9f0cca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:55:50.116896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 613/1233] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:55:50 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:55:50.259079 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058ace-0670-437a-ae4e-f033a1c15e96 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:55:50.268753 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058ace-0670-437a-ae4e-f033a1c15e96 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:55:50.273646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91431-405f-4a99-a8ae-9b61fd0221fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:55:50.274730 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91431-405f-4a99-a8ae-9b61fd0221fe service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:55:50.275172 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91431-405f-4a99-a8ae-9b61fd0221fe service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:55:50.275623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91431-405f-4a99-a8ae-9b61fd0221fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:55:50.290217 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f91431-405f-4a99-a8ae-9b61fd0221fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:55:50.292500 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f91431-405f-4a99-a8ae-9b61fd0221fe service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:55:50.304712 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 621/1234] 10.222.0.60 () {60 vars in 1396 bytes} [Fri Aug 19 14:55:50 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2816 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:56:00.102106 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=3 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:56:00.299606 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=6 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:56:00.598105 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bea8a-2313-49ea-adba-ccf7f9f0cca5 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:56:00.608504 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bea8a-2313-49ea-adba-ccf7f9f0cca5 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:56:00.613413 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fb7da-2ebe-4e4d-9866-4fce00c6d106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:56:00.614067 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb7da-2ebe-4e4d-9866-4fce00c6d106 service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:56:00.614344 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb7da-2ebe-4e4d-9866-4fce00c6d106 service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:56:00.614610 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb7da-2ebe-4e4d-9866-4fce00c6d106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:56:00.624362 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fb7da-2ebe-4e4d-9866-4fce00c6d106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:56:00.625830 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fb7da-2ebe-4e4d-9866-4fce00c6d106 service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:56:00.646592 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 614/1235] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:56:00 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:56:01.848947 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91431-405f-4a99-a8ae-9b61fd0221fe service neutron] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:56:01.858530 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91431-405f-4a99-a8ae-9b61fd0221fe service neutron] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:56:01.862727 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd32d8c-f9ba-4bde-a339-01b1e958f0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:56:01.863387 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd32d8c-f9ba-4bde-a339-01b1e958f0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:56:01.863644 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd32d8c-f9ba-4bde-a339-01b1e958f0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:56:01.863899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd32d8c-f9ba-4bde-a339-01b1e958f0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:56:01.873413 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd32d8c-f9ba-4bde-a339-01b1e958f0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:56:01.874929 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd32d8c-f9ba-4bde-a339-01b1e958f0e1 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:56:01.885686 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 622/1236] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:56:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 14:56:10.643577 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=10 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:56:11.881395 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=6 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:56:12.300952 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fb7da-2ebe-4e4d-9866-4fce00c6d106 service neutron] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:56:12.312071 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fb7da-2ebe-4e4d-9866-4fce00c6d106 service neutron] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:56:12.317625 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd57a23-a815-4f8b-90c0-302452a7870a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:56:12.318273 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd57a23-a815-4f8b-90c0-302452a7870a service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:56:12.318864 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd57a23-a815-4f8b-90c0-302452a7870a service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:56:12.319167 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd57a23-a815-4f8b-90c0-302452a7870a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:56:12.327728 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd57a23-a815-4f8b-90c0-302452a7870a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:56:12.329319 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd57a23-a815-4f8b-90c0-302452a7870a service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:56:12.338470 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 615/1237] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:56:12 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:56:12.515541 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd32d8c-f9ba-4bde-a339-01b1e958f0e1 service neutron] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:56:12.525208 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd32d8c-f9ba-4bde-a339-01b1e958f0e1 service neutron] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:56:12.529705 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fff3ef-da81-465d-946e-770c9e297aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:56:12.530659 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fff3ef-da81-465d-946e-770c9e297aed service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:56:12.531080 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fff3ef-da81-465d-946e-770c9e297aed service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:56:12.531487 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fff3ef-da81-465d-946e-770c9e297aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:56:12.539322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fff3ef-da81-465d-946e-770c9e297aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:56:12.540762 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fff3ef-da81-465d-946e-770c9e297aed service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:56:12.549625 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 623/1238] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:56:12 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:56:22.334403 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=6 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:56:22.546378 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=6 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:56:57.774652 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd57a23-a815-4f8b-90c0-302452a7870a service nova] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:56:57.804704 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd57a23-a815-4f8b-90c0-302452a7870a service nova] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:56:57.813659 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82f1ac-18b9-4142-9988-2db1b00f784e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:56:57.814841 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82f1ac-18b9-4142-9988-2db1b00f784e service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:56:57.815310 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82f1ac-18b9-4142-9988-2db1b00f784e service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:56:57.815765 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82f1ac-18b9-4142-9988-2db1b00f784e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:56:57.831307 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82f1ac-18b9-4142-9988-2db1b00f784e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:56:57.834776 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82f1ac-18b9-4142-9988-2db1b00f784e service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:56:57.853444 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 616/1239] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:56:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:57:06.031485 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fff3ef-da81-465d-946e-770c9e297aed service neutron] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:57:06.041206 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fff3ef-da81-465d-946e-770c9e297aed service neutron] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:57:06.045005 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e2426-8d3a-4993-8e67-88a8c4248a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:57:06.045778 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2426-8d3a-4993-8e67-88a8c4248a76 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:06.046088 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2426-8d3a-4993-8e67-88a8c4248a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:06.046358 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2426-8d3a-4993-8e67-88a8c4248a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:06.114699 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e2426-8d3a-4993-8e67-88a8c4248a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:57:06.116462 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e2426-8d3a-4993-8e67-88a8c4248a76 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:57:06.137159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 624/1240] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:57:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:57:07.846917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=6 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:57:09.738643 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462953ad-1b57-4487-b2bb-a84d8bbf4902 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:09.739316 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462953ad-1b57-4487-b2bb-a84d8bbf4902 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:09.739316 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462953ad-1b57-4487-b2bb-a84d8bbf4902 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:09.740679 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 617/1241] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 14:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 14:57:09.772159 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79c1c1-1929-48b7-a8fe-ffab183d1876 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:09.773243 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79c1c1-1929-48b7-a8fe-ffab183d1876 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:09.773787 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79c1c1-1929-48b7-a8fe-ffab183d1876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:09.861064 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-1e79c1c1-1929-48b7-a8fe-ffab183d1876 None None] MFA Rules not processed for user `6000b5f82dee4ff4abb8935efd8c39df`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:57:09.862528 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-1e79c1c1-1929-48b7-a8fe-ffab183d1876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:57:09.872229 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 625/1242] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 14:57:09 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:57:09.886387 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462953ad-1b57-4487-b2bb-a84d8bbf4902 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:57:09.906318 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462953ad-1b57-4487-b2bb-a84d8bbf4902 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:57:09.913266 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36b3af-9c66-49cc-b8d6-0e5e0c3f8666 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6000b5f82dee4ff4abb8935efd8c39df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:57:09.914257 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b3af-9c66-49cc-b8d6-0e5e0c3f8666 service placement] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:09.915184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b3af-9c66-49cc-b8d6-0e5e0c3f8666 service placement] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:09.915184 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b3af-9c66-49cc-b8d6-0e5e0c3f8666 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:09.926582 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36b3af-9c66-49cc-b8d6-0e5e0c3f8666 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:57:09.928325 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36b3af-9c66-49cc-b8d6-0e5e0c3f8666 service placement] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:57:09.940017 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 618/1243] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:57:09 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:57:13.187237 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79c1c1-1929-48b7-a8fe-ffab183d1876 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:57:13.199244 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79c1c1-1929-48b7-a8fe-ffab183d1876 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:57:13.204633 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:57:13.205318 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:13.205591 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:13.205942 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] PATH_INFO: `/v3/users/7f9df8d2ba0445c5b9552c0ca0aa590b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:13.207245 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9df8d2ba0445c5b9552c0ca0aa590b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:57:13.208322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: WARNING py.warnings [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:57:13.208322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: warnings.warn(msg) Aug 19 14:57:13.208322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: Aug 19 14:57:13.209587 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:57:13.278558 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9df8d2ba0445c5b9552c0ca0aa590b'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.289265 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9df8d2ba0445c5b9552c0ca0aa590b'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.308601 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9df8d2ba0445c5b9552c0ca0aa590b'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.309342 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9df8d2ba0445c5b9552c0ca0aa590b'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.310000 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9df8d2ba0445c5b9552c0ca0aa590b'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.325001 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 626/1244] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Aug 19 14:57:13 2022] DELETE /identity/v3/users/7f9df8d2ba0445c5b9552c0ca0aa590b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:57:13.527686 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36b3af-9c66-49cc-b8d6-0e5e0c3f8666 service placement] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:57:13.539879 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36b3af-9c66-49cc-b8d6-0e5e0c3f8666 service placement] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:57:13.600037 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:57:13.600696 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:13.600975 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:13.601239 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] PATH_INFO: `/v3/projects/6b817056a86a4c00a574546324c51ed3` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:13.602431 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b817056a86a4c00a574546324c51ed3)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:57:13.603499 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: WARNING py.warnings [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 14:57:13.603499 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: warnings.warn(msg) Aug 19 14:57:13.603499 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: Aug 19 14:57:13.604729 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:57:13.668130 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b817056a86a4c00a574546324c51ed3', 'request_id': 'req-b3abbd24-07ce-4559-843d-9eab00fc03c6'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.677282 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b817056a86a4c00a574546324c51ed3', 'request_id': 'req-b3abbd24-07ce-4559-843d-9eab00fc03c6'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.683514 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b817056a86a4c00a574546324c51ed3', 'request_id': 'req-b3abbd24-07ce-4559-843d-9eab00fc03c6'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.703324 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] The token cache is being invalidate because project 6b817056a86a4c00a574546324c51ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 14:57:13.703612 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.704332 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.705941 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 619/1245] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Aug 19 14:57:13 2022] DELETE /identity/v3/projects/6b817056a86a4c00a574546324c51ed3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:57:13.710362 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:57:13.712078 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:57:13.728925 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec18ef-d30a-403c-b026-9042994882b9 admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:57:13.744521 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:57:13.793353 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:57:13.794046 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:13.794322 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:13.794586 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] PATH_INFO: `/v3/users/de6939be9bc848b58b7273d6600a183b` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:13.795825 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6939be9bc848b58b7273d6600a183b)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:57:13.797877 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:57:13.846308 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6939be9bc848b58b7273d6600a183b'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.852969 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6939be9bc848b58b7273d6600a183b'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.864723 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6939be9bc848b58b7273d6600a183b'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.865396 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6939be9bc848b58b7273d6600a183b'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.866020 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-df05edd6-18e0-45df-b784-0cae9c2600dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6939be9bc848b58b7273d6600a183b'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:13.880171 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 627/1246] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Aug 19 14:57:13 2022] DELETE /identity/v3/users/de6939be9bc848b58b7273d6600a183b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:57:14.085484 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:57:14.087056 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:57:14.101122 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abbd24-07ce-4559-843d-9eab00fc03c6 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:57:14.164128 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:57:14.165036 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:14.165415 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:14.165814 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] PATH_INFO: `/v3/projects/b94b690c2cb4425ea2fb798db0bd45f9` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:14.167340 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94b690c2cb4425ea2fb798db0bd45f9)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:57:14.170828 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:57:14.192745 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:57:14.226093 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94b690c2cb4425ea2fb798db0bd45f9', 'request_id': 'req-7b885ecd-2cb3-458b-9844-59233ca84fb8'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:14.234640 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94b690c2cb4425ea2fb798db0bd45f9', 'request_id': 'req-7b885ecd-2cb3-458b-9844-59233ca84fb8'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:14.241419 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94b690c2cb4425ea2fb798db0bd45f9', 'request_id': 'req-7b885ecd-2cb3-458b-9844-59233ca84fb8'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:14.254694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] The token cache is being invalidate because project b94b690c2cb4425ea2fb798db0bd45f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 14:57:14.255118 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:14.255873 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 14:57:14.257536 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 620/1247] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Aug 19 14:57:14 2022] DELETE /identity/v3/projects/b94b690c2cb4425ea2fb798db0bd45f9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 14:57:23.876743 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:57:24.251116 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:57:52.157811 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb978e0-2eba-4f12-b2bf-31cf8503c1b0 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:52.158418 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb978e0-2eba-4f12-b2bf-31cf8503c1b0 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:52.158418 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb978e0-2eba-4f12-b2bf-31cf8503c1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:52.178602 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-0bb978e0-2eba-4f12-b2bf-31cf8503c1b0 None None] MFA Rules not processed for user `7f039b1bc13b4c8ea8bdf95846a1527e`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 14:57:52.179844 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-0bb978e0-2eba-4f12-b2bf-31cf8503c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:57:52.238189 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 628/1248] 10.222.0.60 () {58 vars in 958 bytes} [Fri Aug 19 14:57:52 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 14:57:52.606207 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:57:52.607917 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:57:52.669691 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b885ecd-2cb3-458b-9844-59233ca84fb8 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:57:52.673661 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f02b4-3028-444a-8611-7970d3b38d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:57:52.674305 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f02b4-3028-444a-8611-7970d3b38d0c service neutron] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:52.674573 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f02b4-3028-444a-8611-7970d3b38d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:52.674838 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f02b4-3028-444a-8611-7970d3b38d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:52.676724 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-da3f02b4-3028-444a-8611-7970d3b38d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:57:52.686277 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f02b4-3028-444a-8611-7970d3b38d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:57:52.687703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f02b4-3028-444a-8611-7970d3b38d0c service neutron] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:57:52.696017 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 621/1249] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:57:52 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:57:53.200858 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb978e0-2eba-4f12-b2bf-31cf8503c1b0 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:57:53.202462 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-0bb978e0-2eba-4f12-b2bf-31cf8503c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:57:53.276359 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb978e0-2eba-4f12-b2bf-31cf8503c1b0 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:57:53.281293 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2822ee6-3101-44ff-a93c-5cfc036dd2b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6000b5f82dee4ff4abb8935efd8c39df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:57:53.281905 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2822ee6-3101-44ff-a93c-5cfc036dd2b9 service placement] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:57:53.282212 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2822ee6-3101-44ff-a93c-5cfc036dd2b9 service placement] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:57:53.282481 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2822ee6-3101-44ff-a93c-5cfc036dd2b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:57:53.284221 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-c2822ee6-3101-44ff-a93c-5cfc036dd2b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:57:53.295648 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2822ee6-3101-44ff-a93c-5cfc036dd2b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:57:53.297280 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2822ee6-3101-44ff-a93c-5cfc036dd2b9 service placement] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:57:53.307314 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 629/1250] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:57:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:58:01.587442 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f02b4-3028-444a-8611-7970d3b38d0c service neutron] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:58:01.588981 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-da3f02b4-3028-444a-8611-7970d3b38d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:58:01.684728 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f02b4-3028-444a-8611-7970d3b38d0c service neutron] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:58:01.690232 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026ad1-20d0-402f-aa62-3bb8182de073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:58:01.690874 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026ad1-20d0-402f-aa62-3bb8182de073 service nova] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:58:01.691151 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026ad1-20d0-402f-aa62-3bb8182de073 service nova] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:58:01.691425 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026ad1-20d0-402f-aa62-3bb8182de073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:58:01.693289 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c8026ad1-20d0-402f-aa62-3bb8182de073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:58:01.706283 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026ad1-20d0-402f-aa62-3bb8182de073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:58:01.707933 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026ad1-20d0-402f-aa62-3bb8182de073 service nova] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:58:01.719273 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 622/1251] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:58:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 14:58:03.303039 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=57 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:58:11.715114 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=58 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 14:59:46.460871 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2822ee6-3101-44ff-a93c-5cfc036dd2b9 service placement] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 14:59:46.517588 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2822ee6-3101-44ff-a93c-5cfc036dd2b9 service placement] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 14:59:46.523705 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243841-8591-4e5d-8180-0cba61152be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a9ed9280d249f9a76d037ff8407082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 14:59:46.524393 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243841-8591-4e5d-8180-0cba61152be7 service nova] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 14:59:46.524899 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243841-8591-4e5d-8180-0cba61152be7 service nova] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 14:59:46.525158 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243841-8591-4e5d-8180-0cba61152be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 14:59:46.527103 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-a5243841-8591-4e5d-8180-0cba61152be7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 14:59:46.565964 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5243841-8591-4e5d-8180-0cba61152be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 14:59:46.567790 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5243841-8591-4e5d-8180-0cba61152be7 service nova] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 14:59:46.580623 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 630/1252] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 14:59:46 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 14:59:56.575433 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=28 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:00:03.790929 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026ad1-20d0-402f-aa62-3bb8182de073 service nova] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:00:03.792531 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-c8026ad1-20d0-402f-aa62-3bb8182de073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:00:03.874694 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026ad1-20d0-402f-aa62-3bb8182de073 service nova] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:00:03.880322 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ef810-b660-4189-b9ad-a1eacd4b0749 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6000b5f82dee4ff4abb8935efd8c39df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:00:03.880949 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ef810-b660-4189-b9ad-a1eacd4b0749 service placement] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:00:03.881220 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ef810-b660-4189-b9ad-a1eacd4b0749 service placement] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:00:03.881484 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ef810-b660-4189-b9ad-a1eacd4b0749 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:00:03.883399 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-4d8ef810-b660-4189-b9ad-a1eacd4b0749 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:00:03.895633 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ef810-b660-4189-b9ad-a1eacd4b0749 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:00:03.897226 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ef810-b660-4189-b9ad-a1eacd4b0749 service placement] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:00:03.907393 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 623/1253] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 15:00:03 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:00:13.903545 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=28 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:00:29.092837 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243841-8591-4e5d-8180-0cba61152be7 service nova] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:00:29.104015 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243841-8591-4e5d-8180-0cba61152be7 service nova] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:00:29.107744 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae06437-6fbc-4bee-98c0-63303823fdb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff8273f4715e4f8ca50106a9abf7781b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:00:29.108365 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae06437-6fbc-4bee-98c0-63303823fdb1 service neutron] REQUEST_METHOD: `GET` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:00:29.108639 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae06437-6fbc-4bee-98c0-63303823fdb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:00:29.108905 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae06437-6fbc-4bee-98c0-63303823fdb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:00:29.110856 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-5ae06437-6fbc-4bee-98c0-63303823fdb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:00:29.206505 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae06437-6fbc-4bee-98c0-63303823fdb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:00:29.207991 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae06437-6fbc-4bee-98c0-63303823fdb1 service neutron] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:00:29.219093 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 631/1254] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 15:00:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:00:32.810111 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1afbf6-34cb-41c4-bcb1-370b6299a593 None None] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:00:32.810728 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1afbf6-34cb-41c4-bcb1-370b6299a593 None None] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:00:32.810728 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1afbf6-34cb-41c4-bcb1-370b6299a593 None None] PATH_INFO: `/` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:00:32.812115 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 624/1255] 10.222.0.60 () {54 vars in 921 bytes} [Fri Aug 19 15:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:00:32.823766 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512a46-220e-46a5-8ffd-fd49b850d8a7 None None] REQUEST_METHOD: `POST` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:00:32.824345 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512a46-220e-46a5-8ffd-fd49b850d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:00:32.824941 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512a46-220e-46a5-8ffd-fd49b850d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:00:32.860178 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.auth.core [None req-c3512a46-220e-46a5-8ffd-fd49b850d8a7 None None] MFA Rules not processed for user `6000b5f82dee4ff4abb8935efd8c39df`. Rule list: `[]` (Enabled: `True`). {{(pid=99833) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:00:32.861460 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-c3512a46-220e-46a5-8ffd-fd49b850d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:00:32.872253 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 632/1256] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Aug 19 15:00:32 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:00:32.889530 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1afbf6-34cb-41c4-bcb1-370b6299a593 None None] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:00:32.905644 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1afbf6-34cb-41c4-bcb1-370b6299a593 None None] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:00:32.911290 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af76df-7858-41d5-8d67-e8bd9ec91ca6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6000b5f82dee4ff4abb8935efd8c39df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715f57a8ea67473baf35f0bc91c0ffdb', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:00:32.911909 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af76df-7858-41d5-8d67-e8bd9ec91ca6 service placement] REQUEST_METHOD: `GET` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:00:32.912191 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af76df-7858-41d5-8d67-e8bd9ec91ca6 service placement] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:00:32.912570 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af76df-7858-41d5-8d67-e8bd9ec91ca6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:00:32.922674 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af76df-7858-41d5-8d67-e8bd9ec91ca6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:00:32.924313 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af76df-7858-41d5-8d67-e8bd9ec91ca6 service placement] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:00:32.938669 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 625/1257] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Aug 19 15:00:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:00:36.382258 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3512a46-220e-46a5-8ffd-fd49b850d8a7 None None] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:00:36.382694 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-c3512a46-220e-46a5-8ffd-fd49b850d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:00:36.399944 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3512a46-220e-46a5-8ffd-fd49b850d8a7 None None] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:00:36.405486 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:00:36.409661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:00:36.409661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:00:36.409661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] PATH_INFO: `/v3/users/7f039b1bc13b4c8ea8bdf95846a1527e` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:00:36.409661 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f039b1bc13b4c8ea8bdf95846a1527e)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:00:36.410363 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:00:36.470810 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f039b1bc13b4c8ea8bdf95846a1527e'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:36.479359 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f039b1bc13b4c8ea8bdf95846a1527e'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:36.491579 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f039b1bc13b4c8ea8bdf95846a1527e'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:36.492935 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f039b1bc13b4c8ea8bdf95846a1527e'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:36.493647 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f039b1bc13b4c8ea8bdf95846a1527e'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:36.507915 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 633/1258] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Aug 19 15:00:36 2022] DELETE /identity/v3/users/7f039b1bc13b4c8ea8bdf95846a1527e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:00:36.693845 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af76df-7858-41d5-8d67-e8bd9ec91ca6 service placement] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:00:36.705767 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af76df-7858-41d5-8d67-e8bd9ec91ca6 service placement] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:00:36.779343 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:00:36.780024 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:00:36.780306 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:00:36.780653 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] PATH_INFO: `/v3/projects/f14dc5a98d9d4e2b97bbeb9fa857f760` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:00:36.795383 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14dc5a98d9d4e2b97bbeb9fa857f760)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:00:36.797383 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:00:36.856354 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14dc5a98d9d4e2b97bbeb9fa857f760', 'request_id': 'req-ed69f474-f215-4ad1-9487-3e081ca78bb3'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:36.864251 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14dc5a98d9d4e2b97bbeb9fa857f760', 'request_id': 'req-ed69f474-f215-4ad1-9487-3e081ca78bb3'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:36.870424 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14dc5a98d9d4e2b97bbeb9fa857f760', 'request_id': 'req-ed69f474-f215-4ad1-9487-3e081ca78bb3'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:36.884896 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] The token cache is being invalidate because project f14dc5a98d9d4e2b97bbeb9fa857f760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:00:36.885158 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:36.885953 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:36.887552 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 626/1259] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Aug 19 15:00:36 2022] DELETE /identity/v3/projects/f14dc5a98d9d4e2b97bbeb9fa857f760 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:00:36.892033 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] Authenticating user token {{(pid=99833) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:00:36.893552 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.fernet_utils [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99833) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:00:36.907965 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694bb02-87b7-4fa6-b50b-5cbb3bd5e465 admin admin] Validating token access rules against request {{(pid=99833) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:00:36.941173 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:00:36.977304 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99833) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:00:36.978276 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:00:36.978393 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] SCRIPT_NAME: `/identity` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:00:36.978664 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] PATH_INFO: `/v3/users/7ff4bf369bd7474d88e51325c1be5afa` {{(pid=99833) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:00:36.980186 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff4bf369bd7474d88e51325c1be5afa)` {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:00:36.982504 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] RBAC: Authorization granted {{(pid=99833) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:00:37.037496 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff4bf369bd7474d88e51325c1be5afa'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:37.045396 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff4bf369bd7474d88e51325c1be5afa'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:37.058770 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff4bf369bd7474d88e51325c1be5afa'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:37.059646 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff4bf369bd7474d88e51325c1be5afa'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:37.060288 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG keystone.notifications [None req-c63b6c24-3c68-48d8-9bcd-46e05f46d10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff4bf369bd7474d88e51325c1be5afa'} {{(pid=99833) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:37.075652 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: [pid: 99833|app: 0|req: 634/1260] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Aug 19 15:00:36 2022] DELETE /identity/v3/users/7ff4bf369bd7474d88e51325c1be5afa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:00:37.300446 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] Authenticating user token {{(pid=99834) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:00:37.302068 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.fernet_utils [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99834) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:00:37.320240 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69f474-f215-4ad1-9487-3e081ca78bb3 admin admin] Validating token access rules against request {{(pid=99834) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:00:37.382647 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27969228664649ed9665cfa9861d3064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5667f138f3a41d2b41486682bb7771c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99834) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:00:37.383283 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:00:37.383703 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:00:37.384241 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] PATH_INFO: `/v3/projects/60be6e388ce842a0833ae9a4c6c87862` {{(pid=99834) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:00:37.385260 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=60be6e388ce842a0833ae9a4c6c87862)` {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:00:37.387264 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] RBAC: Authorization granted {{(pid=99834) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:00:37.399969 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:00:37.454925 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60be6e388ce842a0833ae9a4c6c87862', 'request_id': 'req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:37.467677 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60be6e388ce842a0833ae9a4c6c87862', 'request_id': 'req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:37.475460 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60be6e388ce842a0833ae9a4c6c87862', 'request_id': 'req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e'} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:37.488799 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] The token cache is being invalidate because project 60be6e388ce842a0833ae9a4c6c87862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99834) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:00:37.489044 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:37.489737 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG keystone.notifications [None req-80a9f063-e5f0-4fd4-b7ec-684b7cef5c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99834) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:00:37.491391 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: [pid: 99834|app: 0|req: 627/1261] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Aug 19 15:00:37 2022] DELETE /identity/v3/projects/60be6e388ce842a0833ae9a4c6c87862 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:00:47.071349 dv-osbrick-849840-6-ceph devstack@keystone.service[99833]: DEBUG dbcounter [-] [99833] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:00:47.485802 dv-osbrick-849840-6-ceph devstack@keystone.service[99834]: DEBUG dbcounter [-] [99834] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}